REAL ZEROS AND SIZE OF RANKIN-SELBERG 
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Abstract. In this paper, some asymptotic formulas are proved for the 
harmonic mollified second moment of a family of Rankin-Selberg L- 
functions. One of the main new input is a substantial improvement of 
the admissible length of the mollifier which is done by solving a shifted 
convolution problem by a spectral method on average. A first conse- 
quence is a new subconvexity bound for Rankin-Selberg /-functions in 
the level aspect. Moreover, infinitely many Rankin-Selberg //-functions 
having at most eight non-trivial real zeros are produced and some new 
non-trivial estimates for the analytic rank of the family studied are ob- 
tained. 
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1. Introduction and statement of the results 

This paper is motivated by the striking result of J.B. Conrey and K. 
Soundararajan proven in [CoSoJ: 

Theorem (J.B. Conrey-K. Soundararajan (2002)). There exists infinitely 
many (at least 20% in a suitable sense) primitive quadratic Dirichlet char- 
acters x whose Dirichlet L-function L(x,s) := J2 n x( n ) n ~ s does not vanish 
on the critical segment [0, 1] . 
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The family of L-functions considered in |CoSo| is Q := Uxg{2 m ,meN}^(^) 
with 

G{X) := {L ( X _ M , .),2\d^ 2 {d) = l,X<d< 2X) 

where X-8d(n) := (-^) is the Kronecker symbol. The proof, which is based 
on the mollification method, exploits the following properties of the family 
Q: 

• the functional equation of each L-function of this family has the same 
sign; 

• this sign equals +1 and consequently the order of vanishing at the 
critical point \ of each L-function is an even integer; 

• the symmetry type of this family is symplectic - this entails that the 
first zero is repelled from the real axis and justifies the method used 
by the authors. 

K. Soundararajan announced at the Journees Arithmetiques 2003 in Graz a 
similar result for the families TL± := U#-e{2 m ,meN* 

} 7i±(K) with 

7i+(K) := {L(f,.),feSl(l),K<k<2K,k = mod 4} , 
H-{K) := {L(f,.),feS p k (l),K<k<2K,k = 2 mod 4} 

where 5*^(1) denotes the set of primitive cusp forms of level 1, weight k and 
trivial nebentypus. It is then natural to try to generalize these results to 
other families of L-functions. Throughout this article, g will be a fixed prim- 
itive (arithmetically normalized namely with first Fourier coefficient equal to 
one) cusp form of square-free level L>, weight k g and trivial nebentypus Ed, 
and / will be a varying primitive cusp form of level q, weight k and trivial 
nebentypus e q denoted by / G S k (q). We prove a result cognate to that of 
[CoSq] for the family of Rankin- Selb erg L-functions T := U qe pJ r (q) where: 

q\D 

Vq£V, F(q):={L(fxg,.),f£S P k (q)}. 

From now on, L(fxg, .) is the Rankin-Selberg L-function described in section 
4 of [KoMiVal] associated to the pair (/, g) and V denotes the set of prime 
numbers. The family T has the same properties (at least conjecturally) as 
the family Q. The challenge lies in the fact that the analytic conductor 
Q(f x d) sa y °f an y L(f x g, .) in ^{q) is large by comparison with the size 
of ^(g)!; one has 

logQ(fxg) 

— — — — 1 ► 2 as q -> +00 

log I Ho) I 

while for the families Q and TL±, one has 

T^fefe^T ~* X > 1 l0 f^!t\\ ~* 1 as respectively X, K -> +00. 
]og\g(X)\ log \H±{K)\ 

In particular, the second moment in our case (whose evaluation is neces- 
sary to apply the mollification method) is already critical (in the sense of 
|Mi2j); this is not the case of the families Q and TL±, for which the fourth 
moment is critical. Moreover, the L-functions of the family T are Euler prod- 
ucts of degree four (rather than one or two) which significantly increases the 
combinatorial analysis. 
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For q in V and k > 2 an even integer, we define the following harmonic 
averaging operator 

h 

VqtV, A h q [a}:= £ a f := £ *,(/)£*, 

for sequences of complex numbers indexed by and with the harmonic 

weight uj q (f) := ( 47r yHi tj h ((•, -)g i s the Petersson scalar product on the 
space of cusp forms of level g, weight fc and trivial nebentypus). We also 
define the harmonic probability measure on S?(q) by 



for any subset E of S%(q). With these notations, our analogue of the theorem 
of J.B. Conrey and K. Soundararajan is: 

Theorem A. Let g be a primitive cusp form of square-free level D, weight 
kg > 22 and trivial nebentypus. As q — > +oo among primes and f ranges 
over the set of primitive cusp forms of level q, weight k > k g + 6 and trivial 
nebentypus, there are infinitely many (at least 1.8% in a suitable sense) f 
in Sfc(q) such that L(f x g, .) has at most eight non-trivial real zeros. More 
precisely, for q a prime coprime with D, and k > k g + 6, we have: 

/ij ({/ G S p k {q),L(f x g,.)has at most 8 zeros in [0,1]}) > 0.018 + o g (l). 

Remark 1.1. Under the Ramanujan-Petersson-Selberg conjecture (confer 
#2(0) next page), we would obtain 4% of L(f x g, .) having at most 6 non- 
trivial real zeros. However, even this strong and deep hypothesis does not 
seem to give the existence of infinitely many Rankin-Selberg L-functions 
having no zeros in [0, 1] by the present method. 

Remark 1.2. In the course of the proof of theorem A, we also prove that 
the analytic rank of the family T is bounded on average. More precisely, set 

(1.1) r(f x g) := ord s= i L(f x g, s), 

one has 

4^j4?K- x 9)] < 9.82 + 0,(1) 

and we can replace the constant 9.82 by 7.66 under Ramanujan-Petersson- 
Selberg conjecture. Moreover, following the method of [H-BMiJ, one can even 
show the exponential decay of the analytic rank of the family T namely there 
exists some absolute constants B,C > such that: 

-^A h q [exp(Br(.xg))]<C. 

The proof of theorem A relies on some asymptotic formulas for the har- 
monic mollified second moment of the family which is defined by 

2' 



(1.2) W h (g;»):=A h Q 



C[.xg,-+fi 
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where for / G Sf (g) and sGCwe have set 

£(/ x 5 , s) := L(/ x 5 , s)M(f xg,s); 

here, M(/ x g, .) is some Dirichlet polynomial (the so-called mollifier) of the 
following shape 

M(/x ,,.):= ^ 2£l>A /M 
1<^<L 

where the length L > 1 has to be as large as possible. Here, the (■V(^)) 1 <^<.l 
are Hecke eigenvalues of / and the (xi(g, s)) 1<e<L are well chosen mollifying 
coefficients depending on s, g on some parameter < T < 1 and on some 
polynomial P satisfying P(0) = P'(0) = P'(T) = and P(T) = 1 (see 
section 0J. Our key technical result is an asymptotic formula for W h (g;/i) 
when 

T ^<H« r ^ 

log g log q 

for some small absolute constant £o > 0. Given u and v two real numbers 
and A > 0, we define: 

exp (— u) /sinhu sinv 
V(u,v):=l+ 1 



A \ u 



[ exp(-2uA(l 
J o 



2 



dx. 



2(u + iv)A 

Our main first result is an asymptotic formula for W h (g;fJ.) in terms of 
V(u,v); namely for 

A:= l0KL 



log (q 2 ) 

which we call the relative (logarithmic) length of the mollifier, one has 

(1.3) W h (g;n) = V(log (g 2 )K( M ), log (g 2 )9(/i)) + Errsecfe L; //) 

/ 1_ 1 f L- 2!R ^)( 1 - T ) if K( M ) > 0, 

+ \y + log9 | 9 -2SR Ml -4SR( M ) otherwise 

for (5 > an absolute constant and Errsec(g, L; \x) some error term: 

(1.4) Errsec(g, L; /*) = O k , g (-^ 

for some a > as soon as A is small enough in which case A is said to be 
effective. 

Remark 1.3. The asymptotic for the harmonic mollified second moment of 
this family is the same as the asymptotic for the mollified second moment 
of the family of Dirichlet L-functions considered by J.B. Conrey and K. 
Soundararajan. This is consistent with the Random Matrix Model, as these 
two families are expected to have the same symmetry type. 

Remark 1.4. In fact, we also prove that 1)1 .3(1 holds with some weaker 
assumptions on fj,; namely when \x satisfies < \fi\, — < ^St(fi) < 
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and < for some Eq > 0, c > and some non-negative functions 

/l) H with the following properties: 

lim f x {q) = +00, fi(q) = oQogq), f 2 (q) = 0(logq). 

q— >+oo 

In this case, QOj) becomes: 

(1.5) W h (g;n) = V(log (g 2 )^), log (g 2 )9(/i)) + Errsec^, L; /i) 

, n (l 1 !M±fM if»(M)<o,\ 

+ log? | 9 -2RM L -«M otherwise. J 

Our task now is to produce effective positive A. The existence of such A 
is a consequence of the work of E. Kowalski, P. Michel and J. Vanderkam 
( |KoMiVa] ) and their result leads to: 

Proposition C. Let g be a primitive cusp form of square-free level D and 
trivial nebentypus. Assume that q is prime, coprime with D. If \fi\ <C 
then for any natural integer L > 1, 

(1.6) Errsec(q, L; p) = O eAg ([qLf (dq~^ +iV^)) 

for any e > 0. In particular, every A < ^ = 0.01666... is effective. 

This is a consequence of an asymptotic formula for the harmonic twisted 
second moment of this family given by 

(1.7) M h g (p;£):=A h q 

where /i £ C, q £ V, £ > 1 and A.(£) is a Hecke eigenvalue. It is shown in 
[KoMiVal] that (confer Theorem 15. II in this paper): 

Theorem (E. Kowalski-P. Michel-J. Vanderkam (2002)). Let g be a primitive 
cusp form of square-free level D and trivial nebentypus and \x be a complex 
number. Assume that q is prime, coprime with D. If \$t{p)\ <C then for 
any natural integer 1 < i < q, 

(1.8) (qD) m ^ M h g {ix; €) = MT(/x) + Errtwist{q, £; p) 

where MT(ju) stands for the main term and is described in section and a 
bound for the error term is given by 

(1.9) Errtwist(q,£;p) = O sAg ({q£f{l + \%{p)\) B (l^q~^ + £^ g"*)) 

for some absolute constant B > and for any e > 0. 

Nevertheless, this is not sufficient to obtain Theorem A 1 . Our second 
main input is a large improvement of the effective value of A by the in- 
troduction of the spectral theory of automorphic forms. To state our result, 
we introduce the following hypothesis which measures the approximation 
towards the Ramanujan-Petersson-Selberg conjecture. 

^with A < i we would obtain a positive proportion of L( f x g, .) having at most 22 
zeros on [0,1]. 



L 



.Xg,-+p)L 



.Xg,-+p)X.(£) 
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Hypothesis ~H.2(9). For any cuspidal automorphic form 7r on GL2(Q)\GL2 

with local Hecke parameters a^\p), d£\p) for p < oo and /ii (oo), 2 (oo 
at infinity, the following bounds are available: 

< *A 7 = 1,2, 



,00, 



oo 



< 



p , J 

9,3 = 



1,2, 



provided 7r p , -ir^ are unramified, respectively. 



We say that 9 is admissible if #2(0) is satisfied. At the moment, the 
smallest admissible value of 9 is #0 = ^4 thanks to the works of H. Kim, F. 
Shahidi and P. Sarnak (confer [KiShJ and [KiSaJ). 
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Proposition D. Let a be in ]0, 1[. Let g be a primitive cusp form of square- 
free level D, weight k g > 1+ 2 {i- a ) an< ^ trivial nebentypus and be a complex 
number. Assume that q is prime, coprime with D and that k > k g + 6. If 6 
is admissible and "C then for any natural integer i > 1, 

(1.10) 

Errtwtst(q,£ ]f i) = O eAg ((^) £ (1 + |9(/i)|) B (l 2 + e q ~^) + *!+§-« g -(«-5-*))) 

and for any natural integer L>1, 
(1.11) 

Errsec(q,L;ri = O eAg ((qLf{l + \^)\) B (z^V^ + L^^g^- 6 ) 



for some absolute constant B > and for any e > 0. Consequently, under 

1-20 
4(5+20) 



Hzid), every A < A max (9) := j^ftW; «s effective granted that k and k g are 



large enough. 
Remark 1.5. We note that: 

25 

Amax{0 ) = —= 0.03742... 
boo 

A ma x(0) = ^ = 0.05. 

The error term in l|1.8p comes from the resolution of a shifted convolution 
problem by the authors, which builds on the (5-symbol method of W. Duke, 
J.B. Friedlander and H. Iwaniec ( [DuFrlw] ). This error term is improved 
using a technique of P. Sarnak (confer |Sa,| ) which makes systematic use of 
spectral theory of automorphic forms (see section^. However, this method 
alone would only enable us to take A < gfepgj and we have to supplement it 
by additional refinements (in particular by considering the shifted convolu- 
tion problem on average and detecting cancellations throughout large sieve 
inequalities) which lead to an effective length of ^j^e) • Finally, Proposition 
D is obtained thanks to an estimate of triple products on average over the 
spectrum of B. Krotz and R.J. Stanton ( [KrStj and see also (Ko2j). 

Another consequence of our refinements is an improvement over the pre- 
viously known subconvexity bounds for Rankin- Selb erg L-functions in the 
level aspect obtained by the amplification method: 

Theorem B. Let g be a primitive cusp form of square- free level D, weight 
k g > 20 and trivial nebentypus. Let us assume that q is a prime large enough 
and that k > k g + 6. If 6 is admissible then for any natural integer j and 
any f in S^{q), we have 



(1.12) 



<^e,k,j,9 (! + !*! 



\B i-u{8)+ £ 



for any e > where t is real, the exponent B is absolute andoj{6) : = 4 ^ 9+ ^ ■ 

Remark 1.6. In |KoMi Va] . a subconvex bound is obtained but with uj(9) 
replaced by i = 0.0125. Note that u(6 ) = rls = 0.020695... and that 
w (0) = i = 0.027777... 
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One may wonder what happens when one tries to remove the harmonic 
weights in Theorem A. In [KoMij . E. Kowalski and P. Michel provided a 
general technique to deduce asymptotic formulas for the natural average 
-Agfa] := Y2feS p (q) a f f rom asymptotic formulas for the harmonic average as 
long as the coefficients a/ do not increase or oscillate too much as q goes 
to infinity. In our case, one can deduced the same asymptotic formula as in 
lOjt for 

2" 



1 

Mi}' 



C[.xg,- + fi 



but with the length of the mollifier strictly smaller than u(6). In other words, 
it seems that getting rid of the harmonic weights has a cost in this situation. 

Notations. From now on, \i will denote a complex number and r = K(/u), 
t = ^s(fj), 8 = i9(/u). We also set [i\ := \x and \xi := ~p. In several 
places, given an Euler product L(s) = Y\ pe -p L p (s) , we write L( N -j(s) := 

Y\ P \N L p (s) and L^ N \s) := Ylp\N ^p( s ) f° r an y natural integer N. We set: 
log 2 (x) := log (log x), r(n) equals the number of divisors of n and /u(n) is 
the Mobius function at n. We will denote by e and B > some absolute 
positive constants whose definition may vary from line to line. The notations 
/(<?) g{q) or f(q) = Oa(q) mean that \f(q)\ is smaller than a constant 
which only depends on A times g(q) at least for q large enough. Similarly, 
/(g) = o(l) means that lim q ^ +00 f(q) = 0. Finally, if £ is a property, the 
Kronecker symbol 5s equals 1 if £ is satisfied and else. 

For all background and notations about classical modular forms and Rankin- 
Selberg L-functions, we refer the reader to sections 3 and 4 of [KoMiVa] and 
to Appendix C. 

Acknowledgments. I sincerely thank my advisor, Professor Philippe Michel, 
for all his comments and remarks which got the better of my doubts. I also 
think of Professors Etienne Fouvry and Emmanuel Kowalski for their ad- 
vices and encouragements. I wish to thank the Fields Institute of Toronto, 
where part of this work was done, for the excellent working conditions. I 
also acknowledge the referee for a careful reading of the manuscript. 

2. A REVIEW OF CLASSICAL MODULAR FORMS 

In this section, we recall general facts about modular forms. The main 
reference is |Iw2j . For N > 1, we consider r$(N) the congruence subgroup of 
level N and e^v the trivial Dirichlet character of modulus N . All elements of 
GL^"(M) act on the upper-half plane HI by linear- fractional transformations 

and this defines an action of the group SL2(M.) on it. For 7 = ^ ^ m 

G?LJ(R) and z in H we set j(j,z) := cz + d. Let m be an even natural 
integer. For 7 in GL^(M) and h : H — > C, we define: 

v 2£H , hl7(zy .= (jml Hrz) . 
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This formula clearly defines an action of SL2(M) on the space of complex 
valued functions on H, which is said to be of weight m. 



2.1. Cusp forms. A holomorphic function h : H i— ► C which satisfies: 

v 7 g r (N), h\y = h 

and is holomorphic at the cusps of i~b(iV) is a modular form of level N, 
weight m and trivial nebentypus e^v- Such a modular form is a cusp form if 
y~h{z) is bounded on the upper-half plane. We denote by S m {N) this set 
of cusp forms which is equipped with the Petersson inner product: 

-dxdy 



(hi,h 2 ) N = / y m h 1 (z)h 2 {z) ., . 

Jr (N)\w V 

One can obtain the Fourier expansion at infinity of each such cusp form h: 
Vz G H, h(z) = y^Tph(n)n 2 e(nz) 

n>l 

where e(z) := exp (2mz), 

2.2. Hecke operators. For every natural integer I > 1, the Heche operator 
of weight m, nebentypus e^v and rank £ on S m (N) is defined by: 

Vz G H, (2>(fc)) (*) := 4 E £ ^(°) E * • 

Thus, we remark that Tf_ is independent of m and we can prove that it is 
hermitian if gcd(^, N) = 1. Moreover, we can show that the algebra spanned 
by the Hecke operators is a commutative one. More precisely, we have the 
following composition property: 

(2.1) V(h,h) G (N*) 2 , T h oT l2 = E £iv(d)IW 

d\(e u h) 

A cusp form which is also an eigenfunction of the Ti for gcd(^, N) = 1 is 
called a Hecke cusp form and an orthonormal basis of S m (N) made of Hecke 
cusp forms is called a Hecke eigenbasis. 

Atkin-Lehner theory. The main reference of this part is |AtLej . Briefly 
speaking, we obtain, with the previous notations, a splitting of S m (N) in 
S^{N) ® ± <->iv S™(N) where: 



(2.2) S° m (N) 



VectcL(dz),N' I N,d\^,d^l,geS m (N , )\ 



(2.3) S^(N) = (SUN)) X <-^ 

where "o" stands for old and "n" for new. These two spaces are invariant 
under the action of the Hecke operators T\ for gcd(Z,AQ = 1. A primitive 
cusp form h is a Hecke cusp form which is new and satisfies: 

= 1. 

Such an element h is automatically an eigenfunction of the other Hecke 
operators and also of the Atkin-Lehner operators which will be defined later 
and satisfies tph(^) = ^h(^) for all integer I where T^{h) = Xh{i)h (A^(£) is the 
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Heche eigenvalue of rank £). The set of primitive cusp forms will be denoted 
by Sm(N). Let h be a cusp form with Hecke eigenvalues (Xh(£))^ n)=i- The 
composition property Il2.ll! of the Hecke operators entails that for all l\ and 
for gcd(£ 2 ,A0 = 1: 



(2.4) Mh)X h (h) = Y, £ NWh(^r), 

(2.5) MM*) = E rifyNWh ( e j) x h (|) 

and this relation holds for all if h is primitive. The adjointness relation 
is: 



(2.6) Vgcd(4iV) = l, X h (£) = X h (£), ^ h {i)=^ h {i) 
and this remains true for all £ if h is a primitive cusp form. 

2.3. Bounds for Hecke eigenvalues of cusp forms. Let h be a primitive 
cusp form of level N, weight m and trivial nebentypus e^- Remember that: 

WeN*, T e h = X h (£)h. 

For a prime p, let (Xh,i(p) and a^ip) be the complex roots of the following 
quadratic equation: 

X 2 - X h {p)X + e N (p) = 0. 

It follows from the work of Eichler-Shimura-Igusa and Deligne that the 
Ramanujan-Petersson bound holds true: 

(2.7) Kifr)|, K, 2 (p)| < 1 and so W > 1, |A h (*)| < t(£). 
Setting (Jh{n) := Yld\n \Xh{d)\, it entails that: 

(2.8) VX > 0, J] a h (n) 2 < £)ft A 1+£ . 
for all e > 0. 

2.4. Atkin-Lehner operators. The results of this part were established by 
A. Atkin and J. Lehner. We assume that A = A X A 2 with gcd (Ni,N 2 ) = 1. 
Let x, y, z, w four integers satisfying: 

y = 1 mod (Aq) , 
x = 1 mod (A 2 ) , 
Nfxw-Nyz = Aq. 

If ^ = then ^ 



^ is a linear endomorphism of 
S m (N) independent of x, y, z and w. J£ N\ = N then W N is the classical 



1 

Fricke involution given by uj n = ( ^ ^ ) . The following proposition holds: 
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Proposition 2.1 (A. Atkin-W. Li (1970)). If Ni \ N and gcd(N u j^ = 1 
then: 

VheS^(N), W Nl h = r 1h {N 1 )h 

where %(Aq) = ±1. 

3. A REVIEW OF Rankin-Selberg L-FUNCTIONS 
Throughout this section, g\ belongs to S% (Di) and g 2 belongs to S^ 2 {D 2 ). 

3.1. About Rankin-Selberg L-functions. The Rankin-Selberg L-function 
of <7i and g 2 is the following L-function defined a priori for 3J(s) > 1 by: 



L( gi xg 2 ,s) : =C (DlD2) (2.)E Agl( ^ 92(0 - 

l>i 

It admits an Eulerian product L{g\ x g 2 , ■) := EIpGP ^p(ffi x 52, •) where: 



VpG"P,VsGC, L p (g 1 xg 2 ,s)= (l - a gi:i (p)a g2jj (p)p s ) 

1<«J<2 



-1 



By Rankin-Selberg theory, L(gi x g 2 , .) admits a meromorphic continuation 
to the complex plane with at most simple poles at s = 0, 1 which occur 
only if g\ = g 2 . This L-function satisfies a functional equation. When 
gcd (Di,D 2 ) = 1, it takes the following form. We set: 

v» e C. A ( 91 x „, ,) := (^)* r (. + J*lzM) r (, + *1±*! - l) L ( 91 x „, .) 

The functional equation is then: 

Vs e C, A (s>i x 52, s) = £ (51 x ff2 ) A (c/i x 52 ,l - a) 
where the sign of the functional equation in our case is e(gi x 52) = 1- 

3.2. About symmetric square L-functions. Closely related to L{g\ x 
gi, .) is the following Dirichlet series defined for > 1: 

L(Sym 2 ( 5 i),,) : =C (Dl) (2 S )E^- 

i>i 

The Eulerian product of L(Sym 2 ((/i), .) is given by J7 pe p L p (Sym 2 (<7i), .) 
with: 

VpGP,VsGC, L p (Sym 2 (< 7l ), S )= [] (l - a gui (p)a gi j^p' 8 )' 1 ■ 

i<*<i<2 

Hence, we get L(g\ x gi,s) = (( Dl \s)L(Sym 2 gi, s) for all complex number 
s. 
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4. Proof of Theorem A and estimates for the analytic rank 

4.1. Principle of the proof. Let b > 0, c > and o"o > 1 some real num- 
bers. B(q) will denote the rectangular box with vertices (| — E^jij^ 



and ^cro,±^|^j. Let iV be a natural integer and S^(q,N) be the set of 

primitive cusp forms / in S^(q) whose Rankin-Selberg L-function L(f x g, .) 
admits 

• a zero of order 2n\ at 4, 

• and ?i2 zeros (counted with multiplicities) in ] |, l] 

such that 2n\ + 2n2 > 2(N + 1). Let us remark that S^,(q)\S^(q, N) is pre- 
cisely the set of modular forms / in S%(q) whose Rankin-Selberg -L-function 
L(f x g, .) has at most 2N zeros in [0, 1]. We are producing some N such 
that (as q tends to infinity among the primes) 

li\ {S P k (q,N))<s (N)+o g (l) 

with sq(N) < 1 a constant which depends only on N and conclude that 
for at least 100(1 — sq(N)) percent of primitive cusp forms of weight k and 
trivial nebentypus, L(f x g, .) has at most 2N non-trivial zeros on the real 
axis (and in fact in a small box B(q)). 

4.2. Selberg's lemma. 

Lemma 4.1. Let if) be a holomorphic function which does not vanish on a 
half plane ^t(z) > W . Let B be the rectangular box of vertices Wo ± iH , 
W\ ± iH where H > and Wq < W < W\ . We have: 



^ E Hm)^{^2H^ 1 ) = f cosf^logl^o + ^ldt 
/3+i 7 eB ^ J J-H \ J 

^(/3+j 7 )=0 

+ sinh ( ^ a ~ — ^ log \if){a + iH)if){a - iH)\da 
JWo \ 2H J 

- rQT co. (* Wl -™ + a ) C**)M + «))<«. 
A proof of this lemma is given in |D_qHq| and relies on the fact that 

fc(*)(log/)(s)d* = 



with k(s) := cos (tt s 2i H° ) • Let us mention the properties which will be useful 
to us: 

• k is purely imaginary on $s(s) = H and satisfies over there k(s) = 
-k(s), 

• R(Jfe) > in £. 



4.3. The successive steps. We follow the method of J.B. Conrey and K. 
Soundararajan ( |CoSo| ). Lemma l4~T1 applied to the box B(q) and the function 
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L(f x g, .) entails that 
(4.1) 

46sinh(^)r(/ x<?)+46 ^ 



sinh 



'tt(c + log 



^2 logq 

L(fxg,/3)=0 



2b 




where 



I%2) 



4(3) 



L[fxg,- 



t 



log g log g 



di, 



(«*>-*) log, _ /vr(x + C ) . , 

smh I — ) log 



2 log*? 



+ i; 




COS 7T- 



00 



log (/ + c + it 



2i6 



logg 

(logL(/ x 5-,.)) ( + « 



dar, 
t 

logg 



One can show (confer [FQ]) that if / belongs to S^(q,N) then the left-hand 
side of (gjj is larger than (N + 1) X 86sinh (§§). Thus, 



» h q [S P k (q,N)) < 



+ 186 sinh (f ) 



The concavity of the log function leads to 



(4.2) » h q (S P k (q,N)) 



< 



N + 18b sinh (ff) 



jg,h + jg,h + 



^[1] 



^[i?(3)] 



where 



cos — loo 



V 26 7 



1 yife 
AMI] « 



L 



x fl, — h 
y ' 2 



-c + it 



logg 



Id*, 



j: 



(<7 -|)logg /Wx + c 

sinh — 



Similarly, we have from (|4. If) 



(4.3) 



^[1] 




1 x + ib 

2 logg 



A h M q (3)j 



We need the right-hand side of 1)4 . 2 j) and (|4,3|) to be small. Unfortunately, 



the weight function sinh 



Tr(x + c) 

2b 



which appears in J|' fe grows exponentially 

on the horizontal sides of the box. This problem is solved by mollifying: 
one replaces L(f x g, .) by C(f x g, .) such that the exponential growth of 



AM 



\9'i \ogqj)- 



sinh ( ^^fe^ ) * s balanced by the exponential decay of log 

Remark 4.1. Naively, one would like to be able to choose a kernel k having 
the properties listed above in section 14.21 and such that the corresponding 
weight function (in Jf'' 1 ) does not grow exponentially on the horizontal sides 
of B(q). Unfortunately, as K. Soundararajan remarked at the Journees Arith- 
metiques 2003 in Graz, such kernel does not exist. So, it appears that the 
mollification step is a necessity. 
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4.4. Choosing the mollifier. Note that on the half plane 3?(s) > 1, L(f x 
9, s) = J2 n >i a fxg( n ) n ~ s where 

a fx 9 (n) = £ g (ni)££)(ni)A/(n2)A s (n 2 ) 

satisfies \af Xg (n)\ <C e n e for any e > 0. We need the Dirichlet coefficients of 
the inverse of L(f x g, .): 

Lemma 4.2. For > 1 one /ias 

w^ir*" ■ 2s) fc g,3 MWs) 

where K(g, s) := Y\ pe p K p (g, s) is an absolutely convergent Euler product on 
K(s) > 2 (jiwen fry 

Vp G Xp((7, s) := 1 + e q {p)\ g ij) 2 )p- s + e qD {p)p- 2s . 

Proof of lemma 14. 2L We give no details. Setting L(f x g, s) _1 := 
Eoi u ^ S i one s h ows that = except if £ = with £±, £2, £3, 

£4 square-free numbers pairwise coprime: 

ut = ii{hh)e qD (l&)\ f {lit*)\ g {hh) Y, £ 9 (4')^(4)A/(4 2 )A fl (4' 2 )- 

Note that K (g, s) is an absolutely convergent Euler on K(s) > 2 as: 
VpGP, tf p ( 5 ,s) :=l + 0' ' 



p 5R(s) 



Let < T < 1 be a real number and P be a polynomial satisfying P(T) = 1, 
P(0) = P'(0) = P'(T) = 0. Let L > 1 be a natural integer. We set: 



1 if 1 < £ < L x - T 

Fl(£) = < 



Ml) 

logL 

else. 
The mollifier we choose is 

^(£i£2£z)Kh£z)eD(£z)e q {£2h)\ g {£i£z) 



M(fxg,s)=K(g,2s) £ 

£>1 ' 

where 



x e (g,s) = K(g,2s) ^ 
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so that M(f x g, .) is a Dirichlet polynomial of length at most L which 
approximates L(f x g, .) , From the shape of the mollifier, we immediately 
deduce 

(4.4) £(/ xg, S ) = l + £ f L (l-r)(l+e-lft(s)) 



on K(s) > 1 + e for any e > 0. As a consequence, £(/ x g, .) has no zeros 
to the right of 1 + ^j^f (at least for q large enough). Moreover, for q large 
enough, \C(f x <?, s) — 1| < 1 on 3?(s) > 1 + e and we choose the branch of 
the logarithm given by 

(log£(/ x g, .)) (s) := £ (£(/ x 5 , a) - 1)" 

n>l 

on K(s) > 1+e. We are going to give a useful integral expression of the coeffi- 
cients xi{g, s) of the mollifier following a technique introduced in |KoMiVa2] . 
To each polynomial A(X) = J2k>o a kX k and to each real number M, we 
associate the following transform: 

u\ 

V.GC, A M (s) = J2*k (slogM)k . 

We have the following result: 

Lemma 4.3. Let m > 1 6e a natural integer. 



2z7r log M 7(3) \ m J s 2 \ J I \ log M 



where A is the first antiderivative of A without constant of integrat 

Proof of lemma 14. 3L By linearity, it is enough to prove this lemma for 
A(X) = X k with k G N*. Setting y = it consists in proving that 

J_ /" » ds -X logfc+1 (y) 

s^~ dy>1 (fc + 1)! 
which is standard using suitable contour shifts (confer |KoMiV a2j). 

■ 

To the polynomial P, we associate := P((l — T)X + T) — 1 and we 

have the integral expression of the coefficients of the mollifier: 

Proposition 4.4. Let £ > 1 be a natural integer and s be a complex number. 



ion. 



2iir lo. 



l — J Ld-T> (p, {s)L rs _ ^L^As)) K(g, 



*M = ,_ n _ r / 3 ( P' L {s)L Ts - -^R' L1 _ T { S ) ) K{g,2s) 



x 



£1*2*3 



K (e) (g,2s)£f£ s 



s 



2 ' 



Proof of proposition 14.41 The main point is that we have: 
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The previous integral expression of F£ (£) is a direct consequence of lemma 
IP 



4.5. End of the proof. We repeat the same procedure as in section POl hut 
with the mollified Rankin-Selberg L-function instead of the Rankin- Selb erg 
L-function itself. Then, and {OJ become 

(4-5) A AO) < + ^ + IP< [/,(3) 1) 

and 

(4.6) -r^A h a [r{. x g)} < 2 ( Jf h + J|' h + -J_a£[J*(3)A . 

K ' A\\\\ qVy yn ~ 86sinh(f) V q[ - Kn ) 

where 

/ 7rt\ , / 1 ( -c + it 



o 



-(ao-|)log ? ( x + c )\ / 1 / x + ib\, 

J!' ■= I smh {-^)^{AW] w { 9 ^ ]]dx - 



We set b := 26, c := 2c and we choose <jq := 1 + and we assume that A 
is effective. Theorem IA. II leads to: 

(4-7) ^^(3)] « (log.)(^ 4A(1 - T) ) 

This is an error term under the following assumption on the height of the 
box: 

7T 



b> 



4A(1 - T) 
Proposition D leads to: 

j ' ft 4r c ° 8 (3) iog(v( - M))dt+o »(? + i4)- 

Let < /3 < 1 be some real number. We set: 

/•log' 3 (<?) /-(o-o-^logg 
Jf = / ••• + / -:=J?f + jg. 

J-c ./log' 3 (q) 

Our choice of the height of the box (so that all integrals converge), Proposi- 
tion D , Remark 1 1.41 and (| 1 . 3f> entail that 



5 U + " 8i,,h (i) log 



, Trios' 3 (9) \ 

exp — v-^ i 
V(x-c,6)dx + ^ + 



9 5 log 1 "^ 



« ex P f-f4A(l-T)-|))log^(g) 
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and we conclude that 



A (52(9, N)) < 1 . 1 ( f cos ft*) log (V (-c, t))d* 
N + 1 8bsmh(^)\Jo \2bJ 

+ J sinh log (v (x - c,b^dx J + o s (l) 



and that 



[r(. x 5 )] < 2 . 1 f /* cos ft^ log (V (-c, t))dt 



+ J sinh f^|) log (v (x-c,tydx\ + o s (l). 



We choose under H 2 (0), P(x) = 3 (f f - 2 (f ) 3 , b = 4A(1 _r)-w-™ , A = 
&-max{6) — 10~ 10 and we minimize 2 the right-hand side by a numerical choice 
of the remaining parameters. Under fl^^o) , the choice T = 0.44, c = 23 
gives 

and 



' A\ [r(. x </)] < 9.82 + o fl (l). 



^[lp* 



9 

Finally, iV must be 4. 



5. The harmonic mollified second moment near the critical 

POINT 

5.1. The second harmonic twisted moment. E. Kowalski, P. Michel 
and J. Vanderkam computed this moment under some sensible conditions on 
D and k, q. 

We recall here some notations used in |KoMiVa] . For z,s some complex 
numbers, we set 



Ga.Js) 



'~ r(h + z + ^)r(k + z + *&L-i)\ e(|) J P 9 (* 



where £(s) = s(l — s)tt iT (|) £(s) and P g (s) is an even polynomial whose 
coefficients are real and depend only on k and k g chosen such that the func- 
tion P g (s)r (l + s + l^al) r(± + s+ *±r* _ A i s analytic on K(s) > -A 



where ^4 > |. We observe that 

(5.1) VO, s) e C 2 , G g , z (-s) = e z (fx g)G g - z { 8 ) 

2 The program (inte.mws) is available at http://www.dms.umontreal.ca/~ricotta 
3 Under #2(0), we get an d 7.66 if we choose T = 0.45 and c = 23.7. 
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with 

(4vr 2 ) 2 r [\-z + ^ei) r (i - z + ^ - 
£z(/ X 5) := (4^)-*r(^ + z + J^l)r(^ + z + ^- 1 

Then, we set: 

So, it follows that Hg )Z (z) = 1. 

We need to introduce some extra notations. For any (a, (3) = (±/u, ±71) 
and any natural integer £ > 1, we set 



Mg((a,p);e) := ^res u=Q — / J fl (u, w; (a, [3);£){qDf , 
with 

J 9 (u, V ; (a,/3);£) := ^, a (n)C (D) (l + 2n)F gi/3 («)C ((?D) (l + 2v) 

L(g x g, 1 + u + v) 

X C D {2{1+u + v)) 

where 
(5.2) 

„f/. fJ V ) . y 1 Tj(^ ^P k+MS) )^(P k+M£) ) \ ( y A g (p*)A g (p*) 

ISg[(.,U,U) .- £ U v XX ^ „fc(l+U+l>) „fc(l+1t+«) 

p\Se \k>0 1 / \fc>0 1 

Finally, we set: 

e fX g(-n,jL) = e^(fxg), 

£fx g {fJ',-~P) = £ji(fxg), 

Efxg(-I*, -A*) = £a«(/ X X fif). 

One has: 

Theorem 5.1 (E. Kowalski-P. Michel-J. Vanderkam (2002)). Let g be a 
primitive cusp form of square-free level D and trivial nebentypus. Assume 
that q is prime, coprime with D. If \r\ <C j^-^ then for any natural integer 
l<£<q, 

(qD) 2r M h g (fi;£)= J2 e fxg (a,p)M g {{a,p);£) + Errtwist{qJ-fi) 

(a,/3)=(± M ,±7I) 

where 

Errtwist(q,£;v) = O eAg ({q£) £ (1 + \t\) B (i^q^ + £ a *q~ h * 

for any e > with a\ = |, b% = an d °2 = ■§■> ^2 = 4- 

Remark 5.1. Actually, theorem l5.1l was only proved for < 12 so that ^(g) 
has no old forms. We explain in appendix El how to remove this condition 
using a technique of H. Iwaniec, W. Luo and P. Sarnak ( jlwLu SaJ). 
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Coming back to the notation of the introduction, we have: 

MT{fi):= e fxg (a,P)M g ((a,/3);£). 
(o,/3)=(± Ml ±7Z) 

5.2. The harmonic mollified second moment near ^. By opening the 
square and using multiplicative properties of Hecke eigenvalues, one gets 

w\ g ^)=( qD )-^ £ 1 y: grl^ U \ + mi) ^ U \ + M2 

x (qD) 2T M h g (fi;h£ 2 ) 

where one has set \i\ := \i and [12 '-=~p- Our next step is to evaluate W h (g; /J,) 
for [i within a distance O (r^) of the origin (Proposition C). We set for 
(a, (3) = (±//,±p): 

(5.3) \N g (a,P):=(qD)- 2T V — L V -=$^ 

x ^1 ffiS ^ + Ml) ^d£ 2 ^ + M 9 ((a, (3);£i£ 2 )- 
Theorem 15. II leads to: 

Proposition 5.2. Lei g be a primitive cusp form of square-free level D and 
trivial nebentypus. Assume that q is prime, coprime with D. If \r\ <C 
then for any natural integer 1 < L < ^Jq, 

(5.4) W h (g;^ = Yl e fxg (a,p)\N g (a,p) + Errsec(q,L;n) 

(a,/?)=(±M,±p) 

where 

Errsec(q,L^):=( q D)-^ V ^ ^ * + ^ ^ ^ 1 + ^ Jftrfa^g, frfr; M ) 

dli<L 

satisfies 
(5.5) 

Errsec(q,L;^) = O eAg ((qL) £ {l + |t|) B (L 2 ( ai + 5V b i + L 2 ( a2+ ^q~ b2 



for any e > 0. ^4s a consequence, A < inf ( , bl 1 x , -7 b2 1 ■, = A is 

Proof of proposition 15.21 We only have to check the order of magnitude 
of the error term. We get: 



|E m ec( 9 , i; ,)|<E^ £ 

d>l £i,^ 2 >l ^1 ^2 

x ((^ 2 r<r bi + (^ 2 ) a v b2 ) 
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As \x Mi (g, \ + m) | < E L £ £^ i=mim 2 m3 M T = and a i ~ I > °> 

we remark that 

|Errsec(g, L; /i)| < £ (gL) £ ^ i ^ (l 2 ^-^- 61 + L 2 (^-§)g- 6 2 



d>l 

which leads to the result 



d>l l<tx,l2<± 



We study now the main term of the second harmonic mollified moment. 

Proposition 5.3. Let g be a primitive cusp form of square-free level D and 
trivial nebentypus. If |r| <C then there exists S > such that 

e fxg (a,P)\N g (a,l3)= £ H>(a,l3)V {a ^(fi) + £tg (q- s ) 

(a,/?)=(±M,±M) (a,/3)=(±ft±M) 

where for any (a, (3) = (±^, ±Jl) 

i; ^ \ (B m \- 1 (g. I + Mi) x d£ 2 (9, 1 + M2) 

V^^-^^a,/?) ^ 2^^1+777+7^ TA+TTI ]T+F2 

£>i i\ti=i d>l c i *2 

(a, 0) := ^-(qD)- 2 T+°<+Pe fxg (a, (3)L{g x g, 1 + a + /3) 

C (D) (l + 2a)C (9D) (l + 2/3) 



x 



C( D )(2(l + a + /3)) 



Proof of proposition ^. 3l According to (|5.H|1 and the integral expression of 
the coefficients of the mollifier (confer proposition 14, 4p . one gets for (a, (3) = 



^ /"/*/* 

\N g (a,P) = — — — 2res u=Q — — ^ / / / 
qilogLY (^) 3 J (3) J (3) J (3 



(logLy {2m) 6 J {3) J {3) J {3) 

dsi ds2 df 



x m g (u,v,si,s 2 )- 



where we have set: 

m g (u,v,si,s 2 ) := (qD) u+l ' H g ^ a (u)H g ^(v)h g {u,v, s\, s 2 ) 

x^ (1 " T)si (n(si)L Tsi ~ Y^r^ris^ L^ r ^ (9 L (s 2 )L Ts > - -^R 

C (D) (l + 2n)C (<?D) (l + 2^) 

X C (D) (1 + si + 2/i 1 )C( D )(l + s 2 + 2 M2 )C^>(2(1 + u + v)) 
L(g x g, 1 + -u + -i>)L(g x g, 1 + si + a 2 + Mi + Mg) 
L(g x g, 1 + u + s 2 + n 2 )L{g x g, 1 + v + s 2 + M2) 

L(g x g, 1 + si + 2/xi)L(g x g, 1 + s 2 + 2^2) 



L(g x g, 1 + n + si + ;Ui)L(g x g, 1 + u + si + m) ' 

Here, /i 9 satisfies h g (u, v, s±, s 2 ) = h g (v, u, s%, s 2 ) and defines an holomorphic 
function given by an absolutely convergent Euler product if u, v, s\ and s 2 
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all have real part greater than some small negative real number (— 10~ 6 say). 
Thus, the pole at u = a is simple and so: 

\Ng(a,P) = — — / / m g (a,v,s 1 ,s 2 )— § 3- 

g (WL) 2 7 (3 ) J (3) 4 s 2 v - p 

As a function of v, the integrand has three simple poles at v = (3, —a and 0. 
We shift the v-contour to (— \ + e) hitting these three poles and we remark 
that the remaining integral is bounded by q~ s for some 5 > 0. Thus, at an 
admissible cost, we have 

£fxg(ct,P)\N g (a,P)= e fxg (a,PX r i(at,p) + r 2 (a,P) + r 3 (a,p)) 

where n(a, /3) (respectively r 2 (ct,P), rs(a,P)) is the contribution of the 
residue at u = /3 (respectively —a, 0) which comes from \N g (a,P). We 
remark that 

e fX g(a,P)r 2 (a,P) = -e fxg (-a,-P)r 2 (-a,-P), 
£fx 9 (a,P)r3{a,P) = -e fxg (a, ~P)r 3 (a, -0) 
according to 1)5.1(1 . Summing up, we get at an admissible cost 

s(g;ti) W(#;/i) = ^ e /x <,(a,/3)ri(a,/3) 

(a I( S)=(±M,±P) 

which is exactly the main term in proposition 15.31 

■ 

We set for any integers m,n > 1 and for any (a, P) = (±/u,±/Z): 

u g (p 3 ;a,P) 



V g (m,n;a,P) := J [ 



W g (m,n;a,P) := [J 



„_ p l/ $(p;«>/ 3 ) l/ <?(P 2 ; a! >/ 3 ) 

p\\m 
p\\n 

,2.. 



Vg(P ,a,P) 
jip v g (p;a,p) 2 ' 

p\\m 
p\\n 



Lemma 5.4. Zet /iGC and (a, P) = (±/x,±/z). We /lawe 



V(a,/3)(M) = w i+li+»2 ^2 T (a,/3)( u ,v)S UiViW {a, P; [ii)S UiViW {a, P; 

w>l uv\w 

where for z £ {/^i, fj, 2 } 



fi(u)iyg(u 2 ;a,P)ug(v 2 ;a,P)Vg(u,v;a,P) 2 
T (a,/3){ u i v ) = 



uv 

Vg(£;a,p)Vg(e,v;a,p)W g (e,u;a,P) ( 1 



»Jn,i;,ioV a ) Pi z ) — / j £l+ z x wi I 9i 2 i~ z J ■ 



£>1 



Proof of lemma f5.4L One gets setting l\ = ka and £ 2 = kb with a A b = 1: 
/ >, _ v g (k 2 ab;a,P) v - Xdfca (ff, 5 + ^dfcfe (g, 5 + M2) 

fc>laAfe=l d>l 
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As v g is a multiplicative function, ka and kb are cube-free integers and 
a A b = 1, we have: 

u g (k 2 ab; a, 0) = v g (k 2 \ a, f3)v g (a; a, f3)v g (b; a, (3)V g (a, k; a, (3)V g (b, k; a, (3). 

Hence, 

v g (k 2 ;a,(3)fj,(c) 



V(a,/3)(M)= X 



(feed) 1+ ' il+ ' 12 fee 



E^ (ac; a, B)V g (ac, fe; a, /?) / 1 
i ^fe Xdka \9> 2 +fil 

EUg(bc;a,P)V g (bc,k;a,(3) , .. 
^ x dkb I 5 , - + fi 2 



i/ g (bc;a, P)V g (bc,k; a, (3) f 1 

6>1 

Once again, we get 

v g (ac;a,f3) = v g (a\ a, (3)v g (c; a, (3)W g (a, c; a, (3) 
which leads to the right expression stated in the lemma. 

■ 

We set for any (a, (3) = (±/x, ±/Z) 

V (L/?)M := J2 w i+m+n2 Y ^,p)(u,v)S u , v , w (a,f3-vi)S u ^ w {a,(3-ii2), 

l<w<L 1 ~ r uv\w 
L 1 ~ T <w<L uv\w 

and we refer to these by the summation of respectively the short range and 
long range terms. 

5.2.1. Contribution of the short range terms. 

Treatment of S UiViW (q;, (3; z) when 1 < w < L 1_r . We set for any complex 
number z and any natural integer £ > 1 

<PzW •= 2^ ll+Tz Aglhh) 

l=lxt\h 3 

so that 

xe (g, 1 + *)= K(g, l + 2z)^2 M^Fl(£)K {e) (g, 1 + 2z)-\ 
v z J e>i 

We also set for any integers u,v,w > 1 with uv \ w, any real y > 0, any 
complex number s and any polynomial R: 

(5.6) 

r w (.; a, ft ,) = 1 + *,) £ ^ (t "'^' t ;^''' ft " i -- ffl 
x 2^ ^I+2l A s (^i^ 3 )K M (p, 1 + 2z) , 
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(5.7) 

u g (£; a, P)V g (£, v; a, (3)W g (£, u; a, (3) 



P,z)=K(g,l+2z) Y, 



1<£<- 



Finally, we define for any prime number p and any complex number s 
L p [s, a, fj, z) - K p {g, 1 + Iz) + + p 2(i +s+ z) 



and also 

Lp(u, v, w; s, a, /3, z) = K p (g, 1 + 2z) ^1+ 

^(ff, a, g)Vfl (p, o=, f3)W g (p, u; a, P)<j> z (wp) \ 
X p 1+s + 2 ^(w) I' 

We will need a nice zero-free region for L(g X g, 1 + .) (confer [K oMiVa] ): 

Lemma 5.5. Given g as above, there exists c g > depending only on g such 
that the function L(g X g, 1 + .) /ias no zeros in i/ie domain 

s G C,3fc(s) > 



log (2 + |3( S )|) 



Moreover, this function, its inverse and its derivatives up to any order a are 
bounded in modulus in this domain by C g ^$ (1 + Q(s))' 5 for any 5 > 0. 

This will be useful in the following lemma: 

Lemma 5.6. Let z G {fii,^}, (a,/3) = (±/z, ±71), y > w and uv \ w. We 
have: 

(5.8) T Ut%w (s;a,p,z) = 4> z (w)K( w )(g, 1 + 2z)~ 1 h 1 (u, v, w; s, a, p, z) 

L^(Sym 2 (g),l + 2z) 



L(g x g, 1 + s + z + a)L(g x g, 1 + s + z + 0) 



where hi is a holomorphic function when all the complex variables have real 
part greater than some small negative real number given by an absolutely 
convergent Euler product h\{u, v, w; s, a, p, z) := n p e"P hi,p(u, v, w; s, a, P, z) 
with 

(5.9) 

VveV (u vwsaP z)~ L p(9X9A + s + z + a)L p (gxg,l + s + z + P) 

L p q) (Sym 2 (g),l + 2z) 

Lp{s,a,P,z) if p\w, 

x < Lp(u,v,w; s,a, P, z) if p\\w, 
K p (g,l + 2z) if p 2 \\w. 
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As a consequence, if [i is a bounded complex number satisfying \r\ <C 
and R a polynomial satisfying R(0) = R'(0) = then 

(5.10) 

Tu,v,w,y,n( a il3i z ) = ^res s= o4> z (w)K^(g, 1 + 2z)~ 1 hi(u,v,w; s,a, 0, z) 

x LM(SymHg),l + 2z) 1 R m ( lo § (£) ' 

sL(gxg,l + s + z + a)L(gxg,l + s + z + P)j^ o (slogyY y logy 



V log y W/ \ \ \w 

for some Aq > 0. 

Proof of lemma 15. 6L The equation (|5.8|) follows by comparing two Euler 
products. According to lemma IdTTI and its definition, the function h\ is given 
by an Euler product of the following shape (everything was made for and 
the Ramanujan-Petersson bound for Hecke eigenvalues of g are available) 
(5.11) 

Vp € V, h hp (u, v, w; s, a,p,z) = l + O m ^^s+L+^+d^ 

for some finite index set I and some integers ai, 6j, Cj and di. Thus, if all 
the complex variables have some slightly negative real parts such that 

Vie I, M(a,iS + bia + Ci/3 + dkz) > -1 + 8 

for some fixed 5 > then this Euler product absolutely converges and defines 
a holomorphic function. To get l|5.10|l . we use the Taylor expansion of R: 



T u ,v,w, y ,R{oL,P,z) = ^2 Qg ^j ^~ K (w)(gA+2z) 1 h 1 (u, v ,w; s, a, (3, z) 



i#)(0) 1 

x 4> z (w) 



(3) 

L^(Sym 2 (g),l + 2z) /yy ds 



L(g x g, 1 + s + z + a)L(g x 1 + s + z + /3) \w/ ' 

According to the assumptions on fj,, we can find F\ > such that + a) 
and $l(z + (3) > ^||. We move the integral to the line 3ft(s) = i^Tjn 

without crossing any pole and then we cut the integral at the segment 

io g (^) li 'i^y + * J 



at an admissible cost of O ( |0 2 (w)| log (^) T 



where T := exp ( a /log (^) ) . We move the previous line segment to 



- inf + a), 5R(z + /?)) - - *T, - inf (M(z + a), + (3)) - + 

log i log i 

where F2 > is chosen such that this line segment is included in a free-zero 
area for L(g x g, 1 + . + z + a)L(g x g,l + . + z + (3) given by lemma 15.51 
We cross a multiple pole at s = whose residue is precisely the main term 
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in (|5,l()p . The remaining integrals contribute as 



This leads directly to: 



Proposition 5.7. Let z E {fi±, fiz}, (a, f3) = (±//, ±/x) and u,v > 1, If fi is 
a bounded complex number satisfying |r| <C ant? 1 < u> < L 1_T f/ien 

(5.12) S u>v>w (a,P,z) = S (z+ol)iz+ ^ 7 L (/) z {w)K {w) {g,l + 2zy 1 

L^(Sym 2 (g),l + 2z) 



x hi(u, v, w; 0, a, /3, z) 



L(5 x p, 1 + z + a )L( 5 x 5 ,l + z + /?) 



+ o 9 ( — ) ex P ( -An/lor ' 



log q \ w J \ V \ w 

Proof of proposition Let := 1 - P(T + (1 - T)X). We remark 

that: 

<Su,«, m (a, /?, z) = T U}V}W>L>P (a, (3, z) + ^^^y-r^fa, (3, z) 

When applying lemma l5~6l twice, the reader may remark that the only con- 
tribution comes from the values of P and Q and that the other main terms 
coming from the values of the derivatives of P and Q cancel each other; this 
concludes the proof. 

■ 

Treatment of Vr ^Jfi) . We set: 

(5.13) L p (s,a,P) = I J] L°(0,a,P,z) 
\ze{Mi,A«2} 

-(l +s )f / -tt 0g(p)i/p(l,l,p; 0,0, ^,2:) 
P { \ J 1 v K p (g,l + 2z) 

+ ^(p;a,/3)p II if p ( g ,l + 2z) 



v 

v«e{^i,/Lt2} 



# P (<7, 1 + 2z) 



+ II ^P 2 ) )P- 2{1+S) <l + u g (p 2 ;a,P)p- 1 
\ze{^i,/t 2 } / I 

u g (p; a, Pfp' 1 - u g (p; a, /3) 2 v g (p 2 ; a, (3)V g (p,p; a, (3) 2 p~ 2 

+ v g (p 4 ;a,/3)p- 
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Lemma 5.8. Let \i G C, (a, f3) = (±//, ±77) anc? z E } - 



n ( K Jti ) +2z) hi{u ^ w ' Aa '^ z) ) 



w>l uv\w 



X 



L{g x 9 A + s)h 2 (s,a,(3) 



where h 2 is a holomorphic function when all the complex variables have some 
real part greater than some small negative real number given by an absolutely 
convergent Euler product h 2 (s,a, j3) := n P 6"P h%,p( s ' a > P) with 

(5.15) 

L p (g x g, 1 + z + a)L p (g xg,l + z + /3) 



VpeV, h 2 , p (s,a,/3)= H 

ze{Ati,/i2} 



L p q) (Sym 2 (g),l + 2z) 
x L p (g x g, 1 + s)L p (s, a, (3). 



As a consequence, if \r\ <C th 



en 



(5.16) q.ji+m+im XT 



l<w<x uv\w 



n ( g (M) t ( ^2 g ) fei(u ' t, ' tg; °' a ' ftg) ) 



X 

2S{/il,M2} 

-2t\ , m („—2t\ 



K {w) (g,l + 2z) 

L{g xg,l + /i 1 + n 2 )h 2 {m + /i 2 , a, /3) (l - ^~ 2r ) + 9 (a;~ 2r ) . 



Proof of lemma OJ The first part lt5"T31) comes from a computation of 
Euler products. Once again, the shape of the Euler product which defines 
h 2 is 
(5.17) 

1 



Vp e V, h 2 , p (u, v, w; s, a,/3,z) = 1 + O u>V)W ^ 



for some finite index set I and some integers a*, fej, q and rfj. Thus, for 
exactly the same reasons as in the proof of lemma l5~6l f confer l)5.11| ). this 
Euler product is absolutely convergent when all the complex variables have 
some slightly negative real parts. To get 1)5.16(1 . according to explicit Perron's 
formula, our sum equals 

1 f A+iT ds {x a - 2t \ 

— / L(gx g,l + s + 2T)h 2 (s + 2r,a,P)x s — + 0[—^) 

where A > — 2r and T > will be chosen later. We shift the contour to 
3i(s) = —A hitting some poles at s = and s = — 2r. The remaining 

integrals contribute as O g (^j^- + x~ a ~ 2t T^ . We choose T = x A in order 
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to justify the error term in 1|5.16|) . The residues of the crossed poles are 
L(g xg,l + 2r)h 2 (2r, a, (3) - ^^'^ ^(Q, a, P)x^ = 

IT 

L(g xg,l + 2r)h 2 (2r, a, f3) (l - x~ 2r ) + O g {x~ 2r ) . 

■ 

In the following proposition, we estimate ^f a ^{lA- 

Proposition 5.9. Let /x S C and (a,/3) = (±^, ±71). If\/J-\ <C then 

V (t,/3)^) = <W)=0*>7i) Mm + M2, V,~P)L(g x g, 1 + 2r) (l - l~ 2t(1 ~ t) ) 

t-t Lfa)(%m 2 (g),l + 2z) 

i(5X9,l + /i + z)i(3X 5 ,l+Ji + z) 

+ O ( 1 / L -(l-T)(r+inf (»(a),»09))) + L -2(l-T)(r+inf (R(a),R(,8)))\ 

9 Vlog 4 (g) ^ ' 

+ <W)=(^A (io^)^ 2T(1_T) ) • 
Proof of proposition 15.91 Since (z + a)(z + 0) / 0: 

(L(g xg,l + z + a)L(g x g, 1 + z + <C 9 (log g)~ 2 , 

the proposition follows from proposition 15.71 and lemma l5~31 

■ 

Treatment of the short range terms. We sum up the estimate of the 
short range terms in the following theorem: 

Theorem 5.10. Let fi G C. If < <C /or some absolute constant 
eo > then 



(5.18) ^ *(a,(3)vf a ^) = 1 " L- 2 ^- T ) 

+ (1 1 f L ' 2T(1 ' Y) */r:=3i(/x)>0,\ 
9 V9 5 logg |g- 2r L- 4r ( 1 - T ) otherwise J 

for some 5 > 0. 

Proof of theorem IfTTOl As *(a,/3) <C log 3 (g) g-^+^+Z 3 (the worst case 
being (a,/?) = (/i,7i)), proposition 15.91 implies that: 



^2 *( a >^) V (t,^)(M) = ^(V, v) h 2(m+fJ<2, V, v)L{gxg, l+/ii+/i 2 ) 

LW(5ym 2 ( 9 ),l + 2z) 



(a,/?)=(±^±P) 



l_ L -2-d-T) JT 



I(gx 9 ,l + ^ + z)L( s x 9 ,l + /i + 2) 

Q / 1 f L- 2T ( 1 - T ) if t > 0, 

+ 9 V lo g9 I g- 2r X- 4r ( 1 - T ) otherwise. 
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The main term of the previous equality equals: 

y(g) C?(l + 2 V) h 2 (2r, n,Ji) 

q L q (Sym 2 g, 1 + 2fi)L q (Sym 2 g, 1 + 2/2) C (r,) (2(l + 2r)) 
According to proposition ID.3| we have 

(5-19) ^ (2 ^^\ =l + O g fi 

C (D) (2(1 + 2r)) S V9 5 

for some <5 > 0. 



1 _ L -2r(l-T)) . 



Remark 5.2. Equation l|5.19p is the result of tedious but elementary com- 
putations which are carried out in Appendix D. One may find it surprising 
that this apparently rather complicated Euler product turns out to a have 
very simple expression (which in fact is crucial for the method to work). 
This however is a consequence of our choice of mollifler. It is very plausible 
that a more conceptual explanation of this phenomenon can be gotten from 
the random matrix model for the family T of Rankin- Selb erg L-functions 
and the vertical Sato-Tate laws satisfied by the Hecke eigenvalues of modu- 
lar forms. For this, we refer to the recent work of J.B. Conrey, D. Farmer, 
J. Keating, M. Rubinstein and N. Snaith ([CoFaKeRuSnj) who formulate 
very precise conjectures for the moments of central value for many families 
of L-functions (although not for our peculiar family, which certainly can be 
investigated along the same lines) and the talk of C. Hughes at the New- 
ton Institute on amplified and mollified moments of families of L-functions 

(ESI). 

5.2.2. Contribution of the long range terms. 
Treatment of V^, m (/■*)• Arguing along the same lines, we obtain 

Proposition 5.11. Let \i G C and (a,/3) = (±/x, ±7J). If\fi\ <C then: 

(5.20) V^Ou) = haim +/i 2) a, / 9)(^i + fi 2 )L{g Xg,l + m + // 2 ) 

x (res s=1 L(gxg,s))- A I ]J L^(Sym 2 (g), 1 + 2z) \ I a ,p(L, T, P; M ) 

\26{Ml,M2} / 
+ Q ( 1 f L -2(r+mi (»(«),»0B))) + L -(T+lnf (B(a),»09))) + £-2r + L -2r(l-T)\\ 

with 

(5.21) I Q)/3 (L, T, P; fj) := log L F L~ 2t ^ 

Jo 

II ((* + a ^ z + ^ + (2 7o g a L +/?) p/(x) + jJm p " {x) ) J dx - 

Treatment of the long range terms. Firstly, we compute an expression 
for the previous integrals I a> p(L, T, P; //) which are obtained by some inte- 
gration by parts knowing that P(0) = P'(0) = P'(T) = and P(T) = 1. 
The results are given in the following lemma: 



x 
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Lemma 5.12. Let (a,/3) = (±/x, ±/Z), 



logL 



l -2t(1-x) 







P'{x) + 



P"{x) 



dx 



2/i log L 



We sum up the contribution of the long range terms in the following 
theorem: 

Theorem 5.13. Let \i e C. // < |/x| <C ^ /or some e > tfien 
(5.22) 

m£(m) = 



g 2r_ g -2r J26 _ q -28 \ ,-T 

2t log L 25 log L 



jr-2r(l-«) 



P"(z) 



2/i log L 



d.r 



9 Vg 5 logo lg 4t L 4t otherwise J 

for some 5 > 0. 

Proof of theorem ETTSl As *(a,/3) <C log 3 (g) g-^+aH-/^ proposition E3U 
implies that 

(a, / 8)=(± At ,±7Z) (a,/3)=(± M ,±7Z) 

1 fL-Mi-T) if r >0, \ 



logg g" 4r L 



4r r-4r 



otherwise 



with 



tt(a,/3) := (res s=1 L( 5 x 5 , S ))- 4 g 2T -( a+ «/(a,/3)2rL( 5 x 5 ,l+2r)/ l2 (2T,a,/3) 

[] LW(Sym 2 ( 5 ),l+2z) 
v ze{/ii,/i 2 } 

Moreover, (a, /3) = g ^ B1 ^gg + 9 (log 3 (<?)) and I ai/3 (L, T, P; M ) « 



(5.23) 



propositio 
/i 2 (0,0,0) 



^log^fa^ ' According to proposition ID.3| we have 



C (D) (2) 



1 - () :< [ i 



for some 5 > 0. Thus, the contribution of the long range terms is 
^ 4a0(a + a) Ia * {I " r ' P ' fi) 

(a,^)=(±M,±M) Pl PJ 
which is exactly the main term of 1)5.22(1 according to lemma IK. 121 



6. Averaged shifted convolution problems 

This section is the central part of this paper. We give here a way of solving 
shifted convolution problems on average. 
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6.1. Introduction and first result. Let \f : W + x R* + —> M be a smooth 



compactly supported function 

(6.1) Supp(tf) C [Z,2Z] x 



Y -,2Y 
2 



for some real numbers Z, Y > satisfying 
(6.2) 

3P > 0,V(a,/3) E N 2 ,V(z,y) E (M* + ) 2 , A^^p(^!/) <«,/3 ^* +/3 - 

Let at,a 2 > 1 with 0102 < g be some natural integers. One considers the 
shifted convolution problem 

VTiEZ*, S h (^,g;at,a 2 ) := ^ A fl (m)A fl (n)*(aim, a 2 n) 

and the shifted convolution problem on average 

E r (V,g;at,a 2 ) := ^ S h (V,g; at, a 2 ) 

/i=0 mod r 

for any natural integer r > 1. Note that the /i-sum is of length sup(Z, Y), 
Solving the shifted convolution problem (respectively the shifted convolution 
problem on average) consists in finding a non-trivial bound for Sh(^, g', «i , a 2 ) 
(respectively S r (^, g; at, ^2))- The <5-symbol method of W. Duke, J. Fried- 
lander and H. Iwaniec (confer |DuFrIwj and |KoMiVa] ) leads to: 

Theorem 6.1. Let h E Z* and r EN*. If at A a 2 = 1 and ^ satisfies (jHHJ 
ane? (|6.2|) i/ien 

3; 01,02) pi(Z + Y)\{Y Z)\ +e 

for any e > 0. Thus, 

^,g;at,a 2 )^ 9 pl(Z + Y)l(YZ)^ SUp{Z ' Y) 

r 

for any e > 0. 

6.2. The spectral method on average. For some background and nota- 
tions about Maass forms we refer to appendixO All is based on the analytic 
properties of the following Dirichlet series (confer jSa] and [Mil] ) 

( \fo\a 2 ~mh \ k ° 1 
D h (g,at,a 2 ;s) := } \ g (m)\ g {n) ■ (aim + a 2 n) 

a\m—a2n=h 

which is linked to our problem by Mellin's inversion formula 
(6.3) S h (g,ai,a 2 ) = — [ D h (g, at, a 2 ; s)$(/i, s) ds 

where 
(6-4) 

~„ . rh+4Na 2 / u + hu _ h \/ 2h 2h \^ e du 



sup (\h\,h+Na 2 ) 



s 

u — h u + h I u 
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Note that ^f(h, s) = if \h\ 3> sup (Z,Y). The spectral method consists 
in getting a non-trivial individual estimate of Dh(g, ai, a 2 ; s) whereas the 
spectral method on average takes care of the extra average over h. 



Lemma 6.2. If \t satisfies (|f> . 1 1) and (|6.2|) then: 
for any natural integer r\. 

Proof of lemma 16.21 According to the support properties of Vl/ and by 77 

integration by parts, we have 



r±fc+0(inf(Z,y)) V s+V-1 

V(h,s)= - ^— -j^(u)du 

J±h+o(mi(z,Y)) s(s + l)---{s + r)-l) 



"g- 

with 7(11) = (a±6, H^) (4 + ^ - ^) 2 . One shows with (EH that 

7 Wy« / sap (Z,y) \^ 1 

7 W^^inf^yjJ inf (z,y)^ 

which is enough for the proof. 

■ 

One defines the following Maass cusp forms of level Dai 02, weight and 
trivial nebentypus 



V{z) := (a\y) 2 g{a 1 z)(a 2 y) 2 g(a 2 z) 

and 

U h (z,s):= (3t(r*)Y e(.-HR( r z)). 

7£ (ro(Daia 2 )) 00 \ro(Daia 2 ) 

A straightforward computation gives: 

(2Tr) s+kg ~ 1 

D h (g, ai ,a 2 ;s) = — -= = (U h (.,8),V). 

T(s + kg - l)^/a~[a^ 

Let (3 := (uj)j >l a Hecke eigenbasis of Co(Daia 2 ) satisfying (Aq + Xj) Uj = 
with Xj := j + r| and made of eigenfunctions of the reflexion operator 
namely: Vn G Z*,pj(—n) = EjPjin) for some £j £ {±1}- Parseval's equality 
leads to: 

(27r) s+fe9_1 

(6.5) D h (g,ai,a 2 ;s)- 



T(s + k g - l)y/axaa 



+ J_ f°° VW\p K (-h,t) r s-±+it \ 



1 1 " A ' s-l-it 



2 



a,,' ( + - r ] d/ 
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The hypothesis H 2 {9) described in the introduction is a very natural one as 
it allows us to control the size of the discrete part of the right-hand side of 
1)6.5(1 . In fact, H. Iwaniec, W. Luo and P. Sarnak f llwLuSa"] - ) showed that if 
9 is admissible then it is possible to choose f3 with: 

(6.6) wez*, Pj ( h ) « £ + M)) g cosh m) \ h f-h 



for any j > 1 and for any e > Or. P. Sarnak (\Sa\) proved the following 
highly non-trivial individual estimate for the triple products (uj, V): 

(6.7) Vj > 1, (uj,V) < g v^(l + |r,|) fcfl+1 exp ( Z ^) 

The crucial fact is that the exponential growth in j of Pj(h) is balanced 
by the exponential decay in j of [uj, V). Using this, P. Sarnak proved that 
Dh(g, «ij 0,2', s) admits an holomorphic continuation to K(s) > ^+9+e under 
H2{9) for any e > f|Saj). The continuous analogue being true, one obtains 
thanks to Weyl's law for the spectrum and an estimate for the number of 
cusps of the congruence subgroup ro(Daia 2 ) the following estimate for the 
triple products on average over the spectrum 



(6.8) V |(n i ,F)| 2 exp(7r|r J |)+ ' 



\rj\<R KeCusp(r (Da 1 a 2 )) 



X 



R 



E h ( .,^+it ) A 



2 



exp(7r|t|)dt <. g£ (a 1 a 2 R) £ {a 1 a 2 ) 2 R 2k9 ~ 

l-R \ \ * J J 

with x = 4. In fact, B. Krotz and R.J. Stanton f |KrStj ) obtained the same 
estimate but with x = 0. Note that the optimality of this last estimate with 
respect to the parameter R was already proved by A. Good ( |Goj ). Moreover 
E. Kowalski (jKo2j) computed the dependency in the level of g. We can now 

state: 

Theorem 6.3. Let r = q a r £ N* with a G N and r/\q = 1. If 9 is admissible 
and ^ satisfies l)6.ip and (|6.2|) then 

9 ; ai , a 2 ) « e , s <f {^^] ^ +1+£ sup (Z, Y) 1+e+E 



/ / su P (z,y) 

x sup 1, 



1+^ 




for any e > 0. 



Remark 6.1. The shifted convolution problem is said to be balanced when 
Y and Z are of the same size and unbalanced else. In the balanced case, 
theorem 16 .HI is better than theorem 16.11 whereas it is not the case in the 
unbalanced case. At least two reasons for that: 

• in theorem 16.11 Y and Z are almost symmetric parameters, 



4 P. Michel provided a useful averaged version over the spectrum of this upper-bound 



in Mil 
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fco-l 



• in theorem 16.31 y ^^Y) ) ^ 1& l ar S e m the unbalanced case 
(especially when the weight of g is large). 

Our next applications will require the use of both theorems depending on 
the range of the parameters Y and Z. 

6.2.1. Flavour of the proof of theorem Jfi.fA When solving the shifted convolu- 
tion problem on average via the spectral method on average, the main issue 
is to deal with smooth sums of Fourier coefficients of automorphic forms of 
the following shape 



<«■») E ™fe^ (9M) 

h <o (q\ h \) 2 

with 3?(s) = 2 + 6 + e. Up to harmless factors, such a sum equals 

i4/(^ +s -0^ l,J(z '' )dz 

where Uj is the underlying primitive form of Uj of level at most Da\a 2 and 
^ is an integral transform of Thus, bounding sums of Fourier coefficients 
like l|6.9p turns out to bounding L-functions like L (uj, on the critical line 

in the level aspect. Of course, the maximal saving would come from Lindelof 
hypothesis but as we average over a family of Maass forms of level Da\a 2 
large sieve inequalities will achieve Lindelof hypothesis on average. 

6.2.2. Proof of theorem \6'.'A We set 

E r g; at , a 2 ) := Ef B c (*, g; a x , a 2 ) + S™ nt (% 9; a u a 2 ) 

where 

(6.10) E dis°(tt ) := — 4= / 2*+ fc *-V*-i 



x y \ ' \ \ ' l ( Uj ,v) y ^ h ^ p [ {rh h {rh, S )ds 

is the contribution of the discrete spectrum and 

(6.11) Y?™\y,g;a 1: a 2 ):= - 2 - / 2 s+fc ^V^ 



r 

+oo 



-i+it 



+ £ (*(.,i + «),v 

V 9 ; «6Cusp(r (£iaia 2 )) V V 7 



fro mm)-* 

is the contribution of the continuous spectrum. We will only give some details 
for the estimate of E$r sc (vlj, g; a±, a 2 ) but the same method is available for 
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££ ont (\I', g; oi, 02) (confer [RiJ). As q is coprime with Da±a2, ()C.7|I implies 

that 

(6.12) 

V/t G Z*, v / HH°j'( r ^) = \/^NPj(^)Aj(g a ) - 5q\ r 5q\hJf^Pj (r^ 



We study only the contribution coming from the first term of l|6.12jl . By 
Strirling's formula and Cauchy-Schwarz inequality, the contribution of the 
discrete spectrum is bounded by 



Vai02 J{\+e+e) 



{l + \%s)\)- k * 



I (uj , V) 1 2 cosh (7rrj ) 

.|rj|<l+|»( S )| 



E 

\hi<i+|3(«)| 



1 



cosh (7rr,- 



y/¥\h\pj(fh) 



— j \ j {q a )H{q a fh,s) 



|f/i|< 



sup (z,y) 



(g a f|/i|) s 



2x I 



ds. 



According to (|6.8|) but with the refinement of B. Krotz and R.J. Stanton 
(x = 0), the first square-root contributes as 

(a 1 a 2 ) 1+s (l + |9f(a)|)t +fc » +B 
for any e > 0. The second square-root equals 



E 



1 



\N<i+|s( s )| 
where one has set 

f 



cosh (7rrj) 



E 



|n|« 



sup (z,y) 



2x I 



if f f n, 



1 



-e-j \j(q a )H(q a rh, s) if n = fh. 

The large sieve inequality for the Fourier coefficients of Maass forms of weight 
(confer 1|C.2|> ) entails that this second square-root is bounded by 



« e (i + |9f( a )|)a + 



sup {Z,Y) l+£ \ 2 

a+£. 



According to lemma l6~2*l this is bounded by 



a 2- 



( su P (z,y) 



-+V-1 



sup (Z, Y) 



i+e+e 



q2 f2 



+0 



sup 1, 



X 



q 2 y/aiai 

(1 + |3(*)|) 
\s\n 



and we choose 77 = ^ + 1 + (1 + e) = 2 + e to make convergent the s-integral 
in Ef sc (*, 5 ;ai,a 2 ). 
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Remark 6.2. We want to take x as small as possible in Q6.8p because fol- 
lowing large sieve inequality, there appears a power of P and P may be large 
in our next applications. This power is precisely the number of integration 
by parts we have to do and grows linearly with x. This feature puts the 
stress on the fact that the spectral method is not really smooth in the length 
of the spectrum aspect (namely in the i?-aspect in (|6.8j0 . 



7. Proofs of Proposition D and Theorem B 

Following the results of section El we prove Proposition D in subsection 
17.21 and Theorem B in subsection 17. HI These proofs are based on some 
better bound for Errtwist(g, £; fi) than the one given in l|1.9|) . Remember that 
the bound (|1.9p was obtained in [KoMiVa] by implementing the (5-symbol 
method. If we use the spectral method on average described in the previous 
section for certain ranges which depend on the weight functions instead of the 
(5-symbol method, we can get better bounds. Once again, a key ingredient is 
a uniform estimate of P. Sarnak and some technical issues involve verifying 
that weight functions can be handled appropriately ( subsection 17. 



7.1. Description of Errtwist(g, £; fi). In |KoMiVa] . the authors are look- 
ing for asymptotic formulas for the harmonic twisted second moments Aig(fi; I). 
By a standard approximate functional equation for Rankin-Selberg L-functions 
(Theorem 5.3. page 98 of [IwKoJ), they are reduced to estimate sums of the 
form (equation (4.16) page 138 of |KoMiVa] ) 

(7.1, 

m,n>l v \t / \h / 



where (a, 0) = (±/^, ±/x) and 



^f{m)^f{n)\ f (l). 



1 f d 

WG{±/,,±7l},VyeM + , V g M:=—l H g . z (s)t {qD \l + 2s)y- s — 

Zl7T J (3) S — Z 

satisfies 

Vz G {±m,±/I} ,Vy G R + ,VA > 0, V g , z (y) « A (1 + \^)\) B y~ A 

for some B > 0. Applying Petersson's formula (remember that there are no 
old forms in their case) and some dyadic partitions of unity to the m and 
n sums which appears in the non-diagonal term leads to the following term 
(formula (7.5) of (KoMiVaj ) 



(7.2) Errtwistfe «4 J] E ^ E W T, 



M,N>1 ee=£ v ab=e 



M,N 
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with 

Tm,n = —Tm,n(c), 



ceN* 

c=0 mod q 



v-^ cm \ i ( 4tt Jaemn\ 

T m ,n{c) = c 2^ A 9 (m)A g (n)6(m,aen;c)FM,Ar(m,n)J fc _i I 1. 

m,ra>l 

Here, S(m, aen; c) is a Kloosterman sum, Jfc_i is a Bessel function of the 
first kind and (page 151 of |KoMi Vaj) 

F M ,N(x,y) := ^= V g,<* (jfi) V g,P (jfi) Vm(x)vn(v) 

for some smooth function t\m compactly supported in [M/2, 2M] satisfying 
for any i > 0, x i rffj(x) -C 1 and such that 



M>1 



ifa:<§, 

1 if x > 1 



with X/M<x ^ ^ logX. Thus, Fm,n is a compactly supported function 
in [4r,2M ] x [y,2iV] which depends on \x and satisfies (formula (7.6) of 
(KoMiVaj ): 

(7.3) V(i,j) 6 (N*) 2 , xW d%+ d 3 J™f {x,y) « (l + |t|) B (MiV)-|(log( Z )^. 

Truncating at an admissible cost the M and iV sums to M,N <C e (g-D) 1+e 
for any e > and applying Voronoi's formula to the m-sum, l|7.2p becomes 

(7.4) 

Errt w, st(9 , /; „> = I ^ E ^ E ^¥^u^, N 

M,N< e (qD) 1 + e ee=£ * e ab= g V 

+ o a ,..,(( 1 + l*l) B (^ + ,«^f 

with cr 9 (£) := Y] d ^ |A S (0| and 



Tm,n( c ) 



ceN* 

c=0 mod g 



C 2 



with 



where 



rM,iv(c) = ^^EK-^2;c)r-(c) 

^ 2 h^O 



T h( c ) = 2 A 9 (m)A 9 (n)G ( ^p") , 

m-(aeD2)n=/i 

0-(,,„) = 2^^ + ~J i ,_ 1 (i^)j t _ 1 (l«)F M , K ( a , s )d ll . 
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Here, D% := jy^;, D2 stands for the inverse of D2 modulo c, r} g {p%) for an 
Atkin-Lehner eigenvalue (of modulus one), r for the Ramanujan sum and 
Jkg-i for a Bessel function of the first kind. In fact, N = N (l) + 

T M,iv( 2 ) where 



ceN* 

q\\c 



We will only deal with the first term as the same method works for the 
second one with better results. So, c = qc' with d A q = 1. Expanding the 
Ramanujan sum leads to 



(7-5) Wc) = 



<je{ 



with 

Let F be the following function: 



d\c> V 7 ft^O 



-1 if q = l, 
+1 if q = q. 



F( Z , y) = 2ni^D 2 (^) J fc _ x (^) (d 2X , £ dx 

which is compactly supported with respect to y in [ Afct ^ r>2 , 2iVae.D2] ■ The 
shifted convolution problem on average which has to be solved is 

^qd(F,g; l,aeD 2 ). 

In order to get some estimates of the function F, one sets Y := Nae, Z\ : = 
jj, P := 1 + and Z := Z\P 2 > sup(Zi,Y). We need some results 

about the Bessel functions which can be found in [Wai . We know that: 



(7-6) ViGN, (^Yj^^ *f * ) 
\l + xj (1 + x)2 V 1 + X J 

More precisely, Jfc(x) = exp (ix)Vfc(x) + exp (-ix)Vk(x) where 

(7.7) VjeN, ^(xJ^-J-rf-J-)*. 

(1 + x) 2 v 1 + X J 



We prove: 
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Lemma 7.1. For any natural integers a, f3, any real numbers Ai, A2, A3 > 
and any non-negative real numbers z and y, 

aa+p rp 



z y 



d z aQ y (3 



xP 



■a+P 




k-1 



1 + 



1 + 



rV V 1 + 



1 + 



1 



+ (l + f)^(l + 



A 2 



Y 



A 3 ' 



Proof of lemma 17.11 We give only the proof for the case a = f3 = 0, If 
2 < Z then we trivially have 

k-l 



(7.8) F(z,y)<^ k , kg (l + |i|) 



1 



1 + 



1 + ,/f 



1 + 



1 • 

.2 



If 2 > Z then I > 1 integrations by parts lead to 
^ / exp ii^^fzx' 



F(z,y) = \m h 



M 
2D 2 



where f(x) = xV kg -i i^t^ x ) -h-\ (^rv^) F m ,n [D2X 2 , ) satisfies 



f {l \x)«. kM (i + |t|) B (io g(? y 



p 1 



k-l 



1 + 



1 + 



1 + 



1 + 



2 x 



As a consequence, 
(7.9) F(z,y)< kikg (l + \t\) 



b iM 



fc-i 



1 + 



1 + ,/f 



1 + /— 
j- -1- w Zl 



1 -i- — 



P l - 



-21 
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We conclude by collecting Q7.8p and Q7.9p and by remarking that one can 
repeat the same procedure with Jk-i instead of Jk a -i if Y is large. 

■ 

Let p : R — ► R compactly supported in [1,2] satisfying ^ aeN p(2~ a x) = 1. 
We set 

F z (z,y) :=p{2- a z)F(z,y) 

where Z := 2 a . Fz is compactly supported in [Z,2Z] x [^,2Y] and we 
remark that F(z,y) = Ylz=2 a Fz(z,y)- Lemma l7~Tl gives 

(7.io) *V^^f <k M ,AuA 2 ,A 3 (i + \t\) B (io gq r + ^ +A ^ 

fc-1 / rrr s fcg-1 




y \ Z 



xp a+(3 IM \ M Zl \ 1 / V^i 



l | /-^- | i 

2 



l 



for any natural integers a, /3 and for any real numbers A\,A2,A$ > 0. 

7.2. Improvement of the bound of Errtwist(g, £; p) given in l)1.9jl . Let 

us recall that we want to estimate 

Errtwrffe «;„):= f £ ^ ^ E ^^VOT^M 

iW,JV< e (qZ)) 1 + E ee=£ V<3 afe=e V 

where 
(7.11) 



?6{l,g} (c,d)eN* 2 v ' Z>\ 

Z=2 a 



1\\ c 



aeN* 



1 1 

and that Theorem 16 ..SI implies: 

Theorem 7.2. Let c > 1 and c? > 1 some natural integers satisfying q \ \ c, 
d\ |, g S {1)^} anc ^ Z >1. If 8 is admissible then: 

— „ fc-i 
y 



^qd(Fz,g;l,aeD 2 ) <^ £ ,g,Ai,A 3 ,v 9 e + \t\) B y ^r(ae)^ 



1 + ^/zr/ (i-i- 



sn P (z, y ) ^ p2+e SU p (z, y ) / sap (z,y) 
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for any real numbers 7] > and A\, A^,, £ > 0. 



Now, we finish the proof of Proposition D. Proof of Proposition D. Let 

< a < 1 be some real number. Setting C^(x, y) := J2 x <z<y ^qd {Fz,9\ 1> aeD^), 
we split the Z-sum occurring in (|7.1ip as follows 

(7.12) E X ?d (F z ,g;l,aeD 2 ) =C$ d (l,Z?) +0^?^) +C ?d (Z,+oo) 
z>\ 

Z=2 a 
a&i* 

and we refer to the first (respectively second, third) term in the right-hand 
side of H7.12|) as the short (respectively median, long) range terms. The first 
point is that Fz is small when k g is large for 1 < Z < Zf because proposition 
16.41 implies that 



(7.13) F z (z,y) « fc , fcfl {l + \t\) B <f 




fc-1 

Z 



Y \ 2 \Z\ 



for 1 < Z < Zf and for any e > 0. As a consequence, the short range terms 
do not restrict the length of the mollifier at least when k g is large. More 
precisely, if k g > 1 + 2 (i 5 . a ) then one gets thanks to theorem 16.11 (that is to 
say the <5-method symbol): 

(7-i4) E E §*(%)w>w<**v + \t\) B h 

qe{i,q} (c,d)ew 2 v q/ 
q\\c 

1 q 

for some 5 > 0. The long range terms "weakly" restrict the length of the 
mollifier. This is mainly caused by the factor (^) 1 in theorem 17.21 with 
A\ as large as needed. Applying this theorem (that is to say the spectral 
method on average), one gets for 6 admissible and k > k g + 
(7.15) 



96{1,«} (c,d)eN* 2 
l\\c 



^ %^ {£) c?d(z ' +oo) <<fe - 9 ' e (i + '* 




for any e > 0. The main restriction comes from the median range terms. 
Applying theorem 17.21 (that is to say the spectral method on average), one 
gets for 9 admissible and k > k g + Q + | 

( 7 - 16 ) E E f^(^)M^z)«^,ai + N)V 

qe{l,q} (c,d)eN* 2 V J 

q\\c 
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for any e > 0. Collecting these estimates, one gets for 9 admissible, k g > 

1 + 2(T^) and k > k 9 + T + I 
(7.17) 

/ //!+§ / 2 + 9 /f+l-"\\ 

Errtwist'^,^) = O e , fc „ (gf) £ (l + ^- + + 



and so 
(7.18) 



- - a— -— 6 

q2 qz q 2 



/ r 5+20 r 8+26* r^+0--2a:' 
5 1- — 1 



ErrsecfoLjA*) = O eAg ^(gL) £ (l + MfJ-W l^r^ + + 



Thus, every A strictly less than 

, 1-26* 2n - 1 - 2t) 

mi 



4(5 + 29) '2(11 + 20 -4a) 

is effective provided k and A; g are large enough. We choose a := | + | + ^- 
to maximize the last quantity. 



7.3. A new subconvexity bound. As a consequence of the improvement 
of the bound of Errtwist (<?, £; fj,) } we prove the new subconvexity bound 
of Rankin-Selberg L-functions given in Theorem B by applying the am- 
plification method. Setting (as in [KoMiVa] - ) for L > 1 an integer and 
x = {xe) l<i<L a sequence of complex numbers satisfying X£ = if q \ I 

L g (/j,,Ji;L;~x) := ^ x e M g ((fi,Ji);l), 

\<1<L 

one has according to jKoMiVaij (page 151) 

L g (fi,JI;L;lc) = ^Errtwist(g, £■ /i)+O e , J (1 + \t\) B q £ M^TT 

\<1<L \ l<i<L ^£ 

which leads to: 

Proposition 7.3. Let a G ]0, 1[. Let g be a primitive cusp form of square- 
free level D, weight k g > 1 + 2 (i- a ) an< ^ ^ nw0 ^ nebentypus and /x 6 C. 
Assume that q is a prime coprime with D and that k > k g + 6. If 9 is 
admissible and |3i(/x)| <C tt^- then for any 1 < L < q, 



L g (p,JI;L;7) « e , fc , 9 (qL) £ (I + \t\) B 



F* 



i<e<L vt 



/or any e > 0. 
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Proof of Theorem B. As in |KoMi Va] . let Q(.) be the following quadratic 
form: 

2 



1<£<L 



L [ f x 9, 2 + A* 



for L < »/g. We define X := (X£) 1<£<L2 with: 

X« := ^2 ^ x dei x d £ 2 . 

It is proved in |KoMiVa| that Q(~x) <C 9 L g ([i,~p; L 2 ; X). This leads to: 



1<£<L 



<e,k,9 (qL) £ (l + \t\) B q[ \[x\\l 



+ 



' L 4+2d L l+9-2a 



l 

qi' 



+ 



x l 



for any e > 0. We choose the following classical lacunary GL(2)-amplifier: 

'-1 if £ = p 2 with pGP, p<y/L, 
\f(p) if = p with p £ V, p < V~L, 
else. 



^ := < 



With such a choice, 



L [ f X g, - + y, 



« £Ag (qLni+\t\) B f -j=+ q ^ e L^ e + q l +e ^d +e -^ 



Setting L = q 2x with < x < I, we have: 



L[ f x g,- + V 



« £ , k , g f(l + \t\) B inf Iq^ + qk+e+i^)* 

0<x<± \ 



_j_ | +6»-a+(9+26»-4a):r j 



Finally, we choose x = 2 (g+4e) an d a := M + iT^ + 1T^ 2 *° rninimize the 
right-hand side which achieves the proof of Theorem B for j = in a neigh- 
bourhood of the critical line. The other cases (j ^ 0) follow from Cauchy's 
inequalities. 



Appendix A. The harmonic mollified second moment away from 

THE CRITICAL POINT 

The aim of this part is to prove the following bound of W h (g; /j,) when fj, 
is on the right of the origin: 
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Theorem A.l. Let g be a primitive cusp form of square-free level D and 
trivial nebentypus and f be a non-negative function satisfying: 

lira f(q) = +00, 
/(g) = o(logg). 

Assume that q is prime, coprime with D. J/3R(/x) > and A is effective 
then for any < a < 4A(1 — T) ; we have 



(A.l) W\g^) = + O k , g ((1 + \^)\) B q- a ^ 

for some absolute constant B > 0. 

We only give a sketch of the proof of this theorem based on two lemmas 
and a classical convexity argument. As usual, \x is a complex number and 
r := K(/i) and t := £y(/u). On one hand, just on the right of the critical 
point, we have: 

Lemma A. 2. If r = £^ > where f is a non-negative function satisfying: 

lim f(q) = +00, 
<?— >+oo 

f(q) = o(logg) 

and A is effective then 

(A.2) W h (g;^<^ g (l + \t\) B . 

Proof of lemma lA. 21 According to remark OJ Wg(/t) <.k, g 1 if |i| •< 1. 

So, we may assume that \t\ 3> 1. According to proposition 15.31 and its proof, 
we know that up to an admissible error term 

e fxg {a,P)\N g (a,P)= ^ yfap)—— f f h g (a,p, Sl 

x n g (s 1} (ii,a, (3)n g (s 2 ,H2, a, f3)L{g x g, 1 + si + s 2 + 2r)^-^ 
with for z G {/ii, ^2}, 

n 9 ( S ,z,a,/3) := ^^ T)s (%s)£ Ts " YZ^W*)) 

L(g xg,l + g + 2z) 

C^)(l + s + 2z)L(g x g, 1 + a + s + z)L(g x g, 1 + /? + s + z) ' 

We are going to evaluate each term occurring in the previous equality sepa- 
rately. One should remark that 

*(a,/9) « (l + |t|) B log A (g)(g J D)- 2r + a +^ 

for some absolute constants A and B and also that: 

W j \exp(-2/(g)) else. 

So, we are going to give details only for the worst case which is (a, 0) = 
(/i,/l). We shift the si-contour and the S2-contour to H~i^^) without 
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C2 



with 



crossing any poles (c\ > 0). Then, we shift the s% contour to ( 

c\ < (1 — T)c2 < 2(1 — T) hitting some poles at s% = and s\ = S2 — 2r. 
The residual integral is bounded by log" 4 (q) exp (— 4A((1 — T)c2 — c\)f(q)) 
for some A which is admissible. The contribution of the pole at si = S2 — 2r 
is bounded by exp (— 2A(2(1 — T) — ci)f(q)) x \og A (q) for some A which is 
admissible. The contribution of the pole at si = is given by 



1 



C,( D \l + 2n)L(g x g,l + 2r) 2ivrlogL 



+C1 



log 1 , 



h g (jj,,n,0,a 2 ) 



L(g x g, 1 + s 2 + 2/u) 



C( D ) (1 + s 2 + 27x)L( 5 x g, 1 + 2/J + s 2 
x fpJ(s 2 )L Ts2 



1-T 

We shift the S2-contour to (^—{^^j hitting only a pole at S2 = 0. The 

residual integral is bounded by log" 4 (q) exp (— 2A/(g)) for some A which is 
still admissible and the contribution of the pole is given by: 



C( D )(1 + 2/i)C( D )(l + 2]l)L(g xg,l + 2r) 
which is bounded. 



<p(q) C(g)(i + 2g) 

9 C (D) (2(l + 2r)) 



h g (fi,fi, 0,0) 



On the other hand, very far away ^ in the domain of absolute convergence, 
we have: 

Lemma A.3. // r > % + e i/ien 



(A.3) 



£ ( . X g, - + n 



< £ 9' 



-4A(l-T)(r-(I+ £ )) 



/or any e > 0. 



This lemma is an easy consequence of 14.41 as we are in the domain of 
absolute convergence of Rankin-Selberg L-functions. 

Proof of theorem IA.1L Lemma IA.2I and I A. 31 together with a Phragmen- 
Lindelof type principle for subharmonic functions which can be found in [KoJ 
give 

2" 

1 



A, 



C[.xg,- + fi 



« e (i + iti)V (r) 



where a is the affine function satisfying a (tq) = — 4A(1 — T) (tq — + e)) 



and a 



m. 

logg 



0. This leads to 



A, 



£ { • x 9, 2 +Z 2 



<.e (1 + 1*1 



4A(l-T)(r -(l+ £ )) 

\-B„ ™ — —t 



which concludes the proof by choosing e small enough and tq large enough. 
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Appendix B. Bounding the contribution of old forms 

The main purpose of this appendix is to deal with the eventual existence 
of old forms in <Sfc(g) (when k > 12). In other words, we prove that (|1,8|) 
still holds even if there are some old forms in Sk(q)- Let N > 1. We define 
for every integers m, n > 1 the operator A;v by: 

,„ „. . , . . 27T v-^ S(m,n;c) ( \.-KJmn\ 
(B.l) A N {m,n) := 5 m=n + — ^ V ' 4-1 ( — )• 

ceN* ' V c / 

c=0 mod iV 

where S(m, n; c) is the Kloosterman sum for which we recall Weil's bound 
(confer [WeJ): 



(B.2) \S(m, n; c)| < r(c)(m, n, c) 2 ^/c. 

Then, Petersson trace formula expresses this operator as an average over an 
orthogonal basis £>fc(iV) of Sk(N): 

(B.3) A N (m,n) = u N (h)-iJj h (m)tph(n) 

heB k (N) 

where 0Jh{N) <Cfc lo |/^ uniformly with respect to h according to |GoHoLi| . 
H. Iwaniec, W. Luo and P. Sarnak have restricted themselves in |IwLuSaj to 
average over primitive forms: 

Theorem B.l (H. Iwaniec-W. Luo-P. Sarnak (2001)). Let N > 1 be a 
square-free number. 

(B.4) £ u N (h)X h (n)X h (n) = 1 £ ^ lA M (m/ 2 ,n). 

heS*(N) LM=N U[ - U > l\L°° 

The authors showed in KoMi V;i| using Petersson trace formula (confer 
section ITT1 or page 138 of [KoMiVaj l that if there are no old forms in Sk(q) 
and if 1 < £ < q then 

( qD ) m ^M h g (fM;£) = Yl e fxg (a,(3)M g ((a,(3);£) 
(a,/3)=(±M,±/Z) 

and that for any (a, f3) = (±fi,±~jl): 

(B.5) M ff ((a,/3);i) = ^^^^M A#) 

- ve ^ ~ v a 

ao=e 



EX„(m)X„(n) Tr f m\ rr ( aen\ 



m,n>l v \* / \"* 

In our case, there are some old forms as the weight k may be large but their 
contribution is small. 

Proposition B.2. Let g be a primitive cusp form of square-free level D and 
trivial nebentypus. Assume that q is prime, coprime with D. I//1GC and 
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1 < £ < q then 



ee=t ao=e 

EA„(m)A (n) Tr /m \ „ f aen\ , 



m,n>l 



/or some .B > and /or any e > 0. 



As a consequence, if 1 < £ < q then (|l,8p is still valid even if there are 
some old forms. We will need the following easy lemma: 

Lemma B.3. Let N > 1. For every integers m,n>l, we have: 

\/ TTXTl 

(B.7) A N (m,n) <C e (Nmn) £ ±—. 

Proof of proposition IB.2L The multiplicative properties of Hecke eigen- 
values of / and g lead to: 

£ g(e) n(a)e D {a) 



(B.8) M ff ((a,/^) = £^£™^A fl (6) 

• ao=e 



m,n>l V vy 7 V« / / e sP( g ) 

We split the summation as follows: 

(b.9) J2--- + J2---+ E ■■■■=i+ii+iii. 

q\m q\n q 2 \mn 

q 2 \n q 2 \m 

The reader may check using mainly l|7.1j) and 1|B.3|I that III <C e q £y -^-- For 



the first term in (jB.9|) (the same analysis works for the second one), one can 
apply (|B.4|) which gives 



,^ T A (m)A (n) Tr /m\ T , / aen\ , . 

g 2 fn 

1 1 A„(m)A„(n) Tr / m \ Tr / aen \ . . _ 9 
q y-^ q ^ v{q Anj^mn \qL> J \qD J 



q\q°° q\m 
q 2 \n 
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Petersson trace formula 1|B,3|I leads to 



q q\q°° q heSl(l) 



( 



( \ 



. m>l 



in 



qD 



I 



E X g (n)X h (aen) / aen \ 



q q\q°° ^ heS*(l) 



Let us study 762 (the same works for 761} 



n>l 
q\n 



i 



q\\n 



X g (n)X h (aen) ( aen 
~ V ^ {-qD 



7621 + 7622. 



We limit ourselves to give an estimate of 1621. Mellin's inversion formula 
entails that 



(B.12) 



i f . ( 2 . 1 , .A (qD 



(2) 



7621 = — / L ( oe, ^; - + z ) ( ) ^(z)dz 



06: 



with L(ae,q 2 ; z) := ^ n >i A/ l (aen)A 9 (n)n 2 and 

<j 2 fn 



Vz G C, V^z) := 



+oo 



x z ~ %A z ) dz < (i + l<l) M 



As usual, L(ae, g 2 ; z) = fl(ae; z) ^^fe^ where R(ae; z) := En|(ae)« Xh{ae ^ z Xg[n) 

converges on K(z) > and satisfies over there R(ae; z) <C r(ae) <C e (ae) £ for 
any e > 0. Shifting the z-contour to K(z) = e in (|B . 12j) . the convexity bound 
for L(h x g, .) implies that 7621 <C e (c/ae) e (l + \t\) B for any e > 0. The same 



lines give 7622 < e ^g^(l + |t|>° for any e > 0. Finally, 76 <C £i9 i=3^ for 



(aeq) e 
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any e > and we have prove that: 

(B.13) M g (a,A0 = E^E^ M V^) 
- — / Ve t - - v a 

ee=l ao=e 

EA a (m)A„(n") f m\ Tr ( aen\ . , . 
„,„>■ l^) (w) A ' <m ' ae " ) 



ee=l ab=e 



m,n>l 
g 2 | mn 



The second term in ()B.13|1 is bounded by <C E)g (q£) £y ^- for any e > thanks 
to lemma lB~3l 



Appendix C. A review of Maass forms 

In this appendix, we only give the minimal knowledge about Maass forms 
in order to follow the notations which are used in this paper. The reader 
may see |DuFrIw2] for all the details. Let N > 1 be a natural integer. A 
function / : EI — » C is said to be Eo(N)-automorphic of weight and trivial 
nebentypus if it satisfies fi^f-z] = f{z) for any 7 6 Eq(N). We denote 
by Co(N) the space of square-integrable i~b (A)-automorphic functions with 
respect to the scalar product: 



if, 9) / f{z)g{z)y dxdy. 

Jr (N)\w 

The Laplacian Ao := y 2 ^ + jp^j acts on Cq(N) and splits it in eigenspaces. 

There are two components: a discrete one spanned by the so-called Maass 
cusp forms and a continuous one spanned by the Eisenstein series which are 
given for any cusp K of Eq(N) by 

E K (z,s):= £ (SOr-V*))' 

7e(r (7V)) K \r (A) 

where a K is a scaling matrix for the cusp k. The Eisenstein series is holo- 
morphic on Re(s) > 1, admits meromorphic continuation to C with only 
one pole on > \ at s = 1 and are eigenfunctions of the Laplacian: 

(A + \{s)E K (., s)) = with X(s) := s(l - s) and s = \ + ir (r G C). They 
admit the following Fourier expansion 



£ K ^z, i + ir^ = ,5 re=oo +0 re Q +irj ya ir +2ify~ ^ p„(n, r)\n\ a 



(27r|n|y)e(rax) 
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with for any n£Z* 
(C.l) 




-\-2ir 



r(\ + ir) 



E 



8 mod (7U1) 
gcd(5,7ui)=l 
8^j=u mod (wA-^j 

in the space 9(r) < for k = ^ with ui | N, gcd(n, w) = 1, 1 < u < 
gcd (w, ~). Here, K + ir) is some explicit complex number. Let £q(N) 
be the closure for (., .) in Cq(N) of the C- vector space spanned by: 

?/> (9(cr~ 1 7.2:)) ,ip compactly supported in 

L 76(^0 (N)) K \r (N) 

Ao has a continuous spectrum on £o(N) which is [|, +00 [ and its multiplicity 
is the number of cusps of i~o(iV). Moreover, if / belongs to £q(N) then 



f(z) = (f,u )u (z)+ Yl 



K&Cusp{r (N)) 



-n- 



z, — + ir ] dr 



where uq is the constant function of value (Vol(A"o(AQ))~ 2 . Let Cq(N) be 
the (., .)-orthogonal of £o(N): it is the space generated by the Maass cusp 
forms. The Fourier expansion of a Maass cusp form / at infinity is 

f(z) = 2^£ pf(n) \n\ 2 if ir/ (27r|n|y)e(ra) 



where (Ao + A/)/ = and A/ := A(s/) := AQ+ir/). Let {uj)- >l be an 
orthonormal basis of Cq{N) made of Maass cusp forms. If / belongs to Cq{N) 
then 

/0) = £(/>«i)%(2)- 

i>i 

J.-M. Deshouillers and H. Iwaniec established in |DeIwj the following large 
sieve inequalities for all the previous Fourier coefficients 

2 



(C-2) £ 



1 



\r,\<R 



cosh (7rrj) 



E 

Km<M 



a m m 2 



Pj (m) 



# 2 + 



M 1+£ 



Mil; 



(C3) £ 

KGCusp(r (Ar)) 



+R 
R 



r[- + ir 



^ a m m'2 p K (m,r) 



Km<M 



dr < e 



2 M 1+6 \ 1 1 ,,2 
i2 + — T^J Il«ll2 



N 



for i? > 1, any e > and any sequence of complex numbers (a m ) 1<m<M . 
The Hecke operators (T n ) n>l also act on £q(N), commute with Ao and are 
hermitian if gcd(n, N) = 1. A Hecke-Maass cusp form is a Maass cusp 
form which is also an eigenfunction of the T n for gcd(n, N) = 1. A Hecke 
eigenbasis is an orthonormal basis of Cq(N) made of Hecke-Maass cusp forms. 
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For / a Hecke-Maass cups form of Hecke eigenvalues (-V( n )) gcd ( n jv)=i> one 
has for any gcd(mn, N) = 1: 

(C.4) \ f {m)\ f (n) = e N (d)X(mnd- 2 ), 

d\m/\n 

(C.5) Xf(mn) = p(d)£N(d)\f(m/d)\f(n/d). 

d\m/\n 

The action of Hecke operators on the Fourier expansion of a Hecke-Maass 
cusp form / is known: 



(C.6) y/mpf(m)Xf(n) = e N (d)p f (mnd' 2 )J-^-, 

d\mAn 

(C.7) y/mnpf(mn) = p(d)£jsf(d)pf(m/d)^^\f(n/d) 

d\mAn 

for any m, n > 1 with gcd(n, N) = 1. 

Appendix D. The computation of an Euler product 

The purpose of this appendix is to prove that the arithmetical constants 
which appear in the asymptotic formulas of the harmonic mollified second 
moment equal one. More precisely, we prove that equations I|5.i9j) and 1)5. 23 j) 
hold. 

Remember that, according to lemma h 2 {p +~fi, p,p) is an absolutely 
convergent Euler product when the real part of p is greater than a small neg- 
ative real number (say 10 -6 ) namely Ii2(p + ~p, p,~p) = TlpeP ^2,pO^ + A*> PjTO 
with (confer 1)5.15)0 : 

(D.l) 

w _ , / . - _x tt [ L p {g x g, 1 + z + p)L p (g x g, 1 + z + pZ) 
Vp£V,h 2t p(p+p,p,p) = [[ — 7-y- — 

L P (g x 5, 1 + p + p)L p (p + p, //, p) 

where + ~p,p,~p) is defined in (|5.1ri|l . Firstly, we need to have an idea 
of the shape of v g {p k \ u, v) (see 1)5.2)) for its definition) for any prime number 
p, any natural integer 1 < k < 4 and any complex numbers u and v. 

Lemma D.l. Let p be a prime number, 1 < k < 4 be some natural integer 
and u, v be some complex numbers. If Q := p~ 1 , U := p~ u and V := p~ v 
then it turns out that v g (p k ;u,v) is of the following shape: 

v g (p k ;u,v) = (l + e D (p)QUV)- x P gtk (Q,U,V) 

where P g> k(Q,U,V) is some explicit polynomial in three variables whose co- 
efficients depend on £d(q) an d on \ g {p) 1 (1 < i < k). 
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Proof of lemma fD. 1L We set for any natural integers a, b > 0: 
S g (a,b;u,v) :=Y,\{p k+a )\{p k+h )Q k U k V k . 

k>0 

The relationships beetween Hecke eigenvalues of g enable us to express 
S g (a, b; u, v) in function of S g (0, 0; u, v) by induction. More precisely, it shows 
that: 

S g (a, b; u, v) = (1 + e D (p)QUV)- 1 R g ^ b (Q, U, V) 
for some explicit polynomial in three variables R g , a ,b{Q,U,V) whose coef- 
ficients depend on £d(q) and on X g (p) 1 (1 < i < a + b). In addition, one 
remarks that: 

SgfaOwvfrgijp-Mv) = (U + V)S g {l,0;u,v), 
S g (0,0;u,v)v g (p 2 ;u,v) = (U 2 + V 2 )S g (2, 0; u, v) + UVS g (l, 1; u, v), 
Sg(p,0;u,v)vg(p 3 ;u,v) = (U 3 + V 3 )S g (3, 0; u, v) + (U 2 V + UV 2 )S g (2, 1; u, 
S g {Q^u,v)v g {p A ;u,v) = (U A + V 4 )S g (i,0;u,v) + (U 3 V + UV 3 )S g (3,l;u, 

+U 2 V 2 S g (2,2;u,v). 



J 9 

Both previous remarks lead to the result. 



Remark D.l. The proof of lemma IlTTI also gives the explicit procedure we 
used for computing u g (p k ;u,v) for any prime number p, any natural integer 
1 < k < 4 and any complex numbers u and v. 

Having this in mind, we can compute the local factor hz^iji + /Z>MjP) at 
each prime p which does not divide q: 

Lemma D.2. Let \x be a complex number. We have: 

Vp\q, y + ZW) =L 
Ci D) (2(l + M + /l)) 

Proof of lemma ID.2L Once again, we set Q := p' 1 , U := and 
V := p~^. With these notations and knowing the local factors of Rankin- 
Selberg L-functions and symmetric-square L-functions, one computes that 

(D.2) 

L p (g x g, 1 + z + n)L p (g x g, 1 + z + g) \ L p (g x g, 1 + fi + Ji) ^ 
4 9) (Sym 2 ( 9 ),l + 2z) J ^(2(1 +/X + /Z)) 

(1 - A^Qf/VT 1 

if p | .D and p { q and that 
(D.3) 

L p {g x ff , 1 + z + n)L p (g x g, 1 + z + g) \ L p (ff x g, 1 + fi + ~p) 
Lp q) (Sym 2 (g),l + 2z) J cf } (2(l + M + /Z)) 

1 + 

(1 - Qt/ 2 )(1 - QF 2 )(1 - QtfV)(l + 2Q£/y - A 9 (p) 2 Q?7y + Q 2 C/ 2 F 2 ) 
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if p | (Dq). According to lemma IdTTI and its definition, + /Z, p-,~fi) for 

any prime number p is, a priori, a rational fraction in three variables Q, U 
and V; namely it looks like 

for some polynomials Pi and P2 of total degrees less than 20 whose coeffi- 
cients depend on e q (p), £d(p) and on the Hecke eigenvalues of g at the powers 
of p namely \ g (p) k for 1 < k < 4. To factor this fraction we have used a 
computational algebra system; for instance the scripts of this computation 
(vg.mws, ctemumubar.mws and cte.mws) are available at 
http://www.dms.imiontreal.ca/~ricotta . We obtain 

(D.4) L p ([i + -p,n,Jl) = l-X g (p) 2 QUV 

if p I D and p \ q and 
(D.5) 

T , _ _* (l-QU 2 )(l-QV 2 )(l-QUV)(l + 2QUV-X g (p) 2 QUV + Q 2 U 2 V 2 ) 

/^) = y^quv 

if p \ Dq. Note that the computations above are purely formal (no numerical 
approximation is made); in fact, once the above factorizations have been 
obtained, it is possible (but lenghtly) to check them directly by hand. Then 
we finish the proof of lemma D.2 by simplifying l)D.2|l with 1)D.4|) and (|D. 
with (EH. 



We can now state the main result: 

Proposition D.3. Let \x be a complex number with r := K(/i) > —7 for 
some 7 > small enough. We have: 

C^)(2(l+^ + 7l)) l + U9 \q* 
for some 5 > 0. 

Proof of proposition ITP1 The proof is an immediate consequence of 
the previous lemma as the various Euler products are absolutely convergent 
under the assumption made on ^. The admissible error term comes from the 
local factor of the Euler product at the primes which divide q. 
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